Aug 26 18:47:02 devstack cinder-volume[82598]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 18:47:02 devstack cinder-volume[82598]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 18:47:02 devstack cinder-volume[82598]: we strongly recommend against using it for new projects. Aug 26 18:47:02 devstack cinder-volume[82598]: If you are already using Eventlet, we recommend migrating to a different Aug 26 18:47:02 devstack cinder-volume[82598]: framework. For more detail see Aug 26 18:47:02 devstack cinder-volume[82598]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 18:47:02 devstack cinder-volume[82598]: import eventlet # noqa Aug 26 18:47:04 devstack cinder-volume[82598]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 18:47:04 devstack cinder-volume[82598]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 18:47:04 devstack cinder-volume[82598]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 18:47:05 devstack cinder-volume[82598]: INFO dbcounter [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Registered counter for database cinder Aug 26 18:47:06 devstack cinder-volume[82598]: DEBUG oslo_db.sqlalchemy.engines [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:47:06 devstack cinder-volume[82598]: DEBUG dbcounter [-] [82598] Writer thread running {{(pid=82598) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 18:47:06 devstack cinder-volume[82598]: INFO cinder.rpc [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 18:47:06 devstack cinder-volume[82598]: INFO cinder.rpc [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 18:47:06 devstack cinder-volume[82598]: DEBUG oslo_db.sqlalchemy.engines [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:47:06 devstack cinder-volume[82598]: INFO cinder.volume.manager [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Determined volume DB was empty at startup. Aug 26 18:47:06 devstack cinder-volume[82598]: DEBUG cinder.volume.manager [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82598) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 18:47:06 devstack cinder-volume[82598]: INFO cinder.volume.manager [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 18:47:06 devstack cinder-volume[82598]: WARNING stevedore.named [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 18:47:06 devstack cinder-volume[82598]: WARNING castellan.key_manager [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 18:47:06 devstack cinder-volume[82598]: WARNING cinder.keymgr.conf_key_mgr [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 18:47:06 devstack cinder-volume[82598]: DEBUG cinder.volume.drivers.lvm [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82598) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 26 18:47:06 devstack cinder-volume[82598]: DEBUG oslo_concurrency.processutils [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:06 devstack cinder-volume[82598]: DEBUG oslo_concurrency.processutils [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] CMD "cinder-rtstool verify" returned: 0 in 0.392s {{(pid=82598) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_db.sqlalchemy.engines [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:47:07 devstack cinder-volume[82598]: INFO cinder.rpc [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 26 18:47:07 devstack cinder-volume[82598]: INFO cinder.rpc [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 26 18:47:07 devstack cinder-volume[82598]: WARNING stevedore.named [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 18:47:07 devstack cinder-volume[82598]: WARNING castellan.key_manager [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 18:47:07 devstack cinder-volume[82598]: INFO cinder.volume.manager [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_db.sqlalchemy.engines [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82598) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:47:07 devstack cinder-volume[82598]: INFO oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Starting 1 workers Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Started child 82753 {{(pid=82598) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Full set of CONF: {{(pid=82598) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] ******************************************************************************** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Configuration options gathered from: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] ================================================================================ {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] allow_availability_zone_fallback = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] allow_compression_on_image_upload = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] allowed_direct_url_schemes = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] api_rate_limit = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] auth_strategy = keystone {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] az_cache_duration = 3600 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_availability_zone = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_host = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82753]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_stats_polling_interval = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backup_api_class = cinder.backup.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backup_name_template = backup-%s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backup_use_same_host = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backup_use_temp_snapshot = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] chap_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] chap_username = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cinder_internal_tenant_project_id = 5fc3e78795c442d1b5c977d018386361 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cinder_internal_tenant_user_id = 9c87c130ccf742a0b3c7e43f3929cb5a {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cloned_volume_same_az = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cluster = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] compression_format = gzip {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] compute_api_class = cinder.compute.nova.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] config_dir = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] config_source = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] control_exchange = openstack {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] debug = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] default_availability_zone = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] default_group_type = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] default_volume_type = lvmdriver-1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] disk_geometry = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] driver_client_cert = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] driver_client_cert_key = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] driver_data_namespace = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] driver_ssl_cert_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] driver_ssl_cert_verify = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] driver_use_ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] enable_force_upload = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] enable_new_services = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] enable_unsupported_driver = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] enforce_multipath_for_image_xfer = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] filter_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_api_insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_api_servers = ['http://192.168.122.224/image'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_api_ssl_compression = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_ca_certificates_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_catalog_info = image:glance:publicURL {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_num_retries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance_request_timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] goodness_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] graceful_shutdown_timeout = 5 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] group_api_class = cinder.group.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] host = devstack {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_compress_on_upload = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_conversion_address_space_limit = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_conversion_cpu_limit = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_conversion_disable = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_upload_use_cinder_backend = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_upload_use_internal_tenant = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_volume_cache_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_volume_cache_max_count = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] image_volume_cache_max_size_gb = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] init_host_max_objects_retrieval = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] instance_format = [instance: %(uuid)s] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] iscsi_target_flags = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] iscsi_write_cache = on {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] iser_helper = tgtadm {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82753]: INFO cinder.volume.manager [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] iser_ip_address = 192.168.122.224 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] iser_port = 3260 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] log_color = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] log_config_append = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] log_dir = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] log_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] log_options = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] log_rotate_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] log_rotate_interval_type = days {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] log_rotation_type = none {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] max_age = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] max_logfile_count = 30 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] max_logfile_size_mb = 200 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] max_over_subscription_ratio = 20.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] message_reap_interval = 86400 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] message_ttl = 2592000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] migration_create_volume_timeout_secs = 300 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] monkey_patch = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] monkey_patch_modules = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] my_ip = 192.168.122.224 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] no_snapshot_gb_quota = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] num_iser_scan_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] num_shell_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] num_volume_device_scan_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] nvmeof_conn_info_version = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] nvmet_ns_id = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] nvmet_port_id = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] osapi_max_limit = 1000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] osapi_volume_ext_list = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] osapi_volume_listen_port = 8776 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] osapi_volume_use_ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] osapi_volume_workers = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] per_volume_size_limit = -1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] periodic_fuzzy_delay = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] periodic_interval = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] public_endpoint = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] publish_errors = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] quota_backup_gigabytes = 1000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] quota_backups = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] quota_gigabytes = 1000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] quota_groups = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] quota_snapshots = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] quota_volumes = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] rate_limit_burst = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] rate_limit_except_level = CRITICAL {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] rate_limit_interval = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] reinit_driver_count = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] replication_device = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] report_discard_supported = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] report_interval = 120 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] reservation_clean_interval = 86400 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] reservation_expire = 86400 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] reserved_image_namespaces = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] reserved_percentage = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] rpc_response_timeout = 120 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] run_external_periodic_tasks = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] scst_target_driver = iscsi {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] scst_target_iqn_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_down_time = 720 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] shell_completion = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] snapshot_name_template = snapshot-%s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] snapshot_same_host = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] state_path = /opt/stack/data/cinder {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] storage_availability_zone = nova {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] storage_protocol = iSCSI {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] syslog_log_facility = LOG_USER {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] target_helper = lioadm {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] target_ip_address = 192.168.122.224 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] target_port = 3260 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] target_protocol = iscsi {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] target_secondary_ip_addresses = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] trace_flags = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] transport_url = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] until_refresh = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] use_chap_auth = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] use_default_quota_class = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] use_journal = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] use_json = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] use_multipath_for_image_xfer = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] use_stderr = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] use_syslog = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] verify_glance_signatures = enabled {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_api_class = cinder.volume.api.API {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_backend_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_clear = zero {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_clear_ionice = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_clear_size = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.068s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_copy_bps_limit = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_dd_blocksize = 1M {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_name_template = volume-%s {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_service_inithost_offload = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volume_usage_audit_period = month {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] zoning_mode = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_concurrency.disable_process_locking = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.auth_section = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.auth_type = password {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.auth_version = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.cache = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.include_service_catalog = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.interface = public {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcache_username = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.region_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.service_type = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.224/identity {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.backend = dogpile.cache.null {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.backend_argument = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.backend_expiration_time = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.config_prefix = cache.oslo {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.debug_cache_backend = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.enable_retry_client = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.enable_socket_keepalive = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.expiration_time = 600 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.hashclient_retry_attempts = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.memcache_dead_retry = 300 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.memcache_pool_maxsize = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.memcache_sasl_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.proxies = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.redis_db = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.redis_server = localhost:6379 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.retry_attempts = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.retry_delay = 0.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.socket_keepalive_count = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.socket_keepalive_idle = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.socket_keepalive_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.socket_timeout = 1.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.tls_allowed_ciphers = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.tls_cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.tls_certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.tls_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.tls_keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cache.username = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] coordination.backend_url = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.asyncio_connection = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.asyncio_slave_connection = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.backend = sqlalchemy {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.connection = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.connection_debug = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.connection_parameters = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.connection_recycle_time = 3600 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.connection_trace = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.db_inc_retry_interval = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.db_max_retries = 20 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.db_max_retry_interval = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.061s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:07 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.db_retry_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.max_overflow = 50 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.max_pool_size = 5 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.max_retries = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.mysql_wsrep_sync_wait = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.pool_timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.retry_interval = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.slave_connection = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.sqlite_synchronous = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.synchronous_reader = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] database.use_db_reconnect = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.connection_string = messaging:// {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.es_doc_type = notification {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.es_scroll_size = 10000 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.es_scroll_time = 2m {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.filter_error_trace = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.hmac_keys = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.sentinel_service_name = mymaster {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.socket_timeout = 0.1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.trace_requests = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler.trace_sqlalchemy = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler_jaeger.process_tags = {} {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler_jaeger.service_name_prefix = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] profiler_otlp.service_name_prefix = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.enforce_new_defaults = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.policy_default_rule = default {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.policy_file = policy.yaml {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] privsep_osbrick.group = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] privsep_osbrick.helper_command = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] privsep_osbrick.user = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cinder_sys_admin.group = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:07 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cinder_sys_admin.helper_command = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] cinder_sys_admin.user = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.auth_section = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.auth_type = password {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.collect_timing = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.send_service_user_token = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] service_user.timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.auth_section = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.auth_type = password {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.collect_timing = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.region_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] glance.timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.backend_availability_zone = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.chap_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.chap_username = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.disk_geometry = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.driver_client_cert = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.driver_client_cert_key = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.driver_data_namespace = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.driver_use_ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.extra_capabilities = {} {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.filter_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.goodness_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.iscsi_target_flags = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.iscsi_write_cache = on {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.iser_helper = tgtadm {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.iser_ip_address = 192.168.122.224 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.iser_port = 3260 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack sudo[82757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 26 18:47:07 devstack sudo[82757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.lvm_share_target = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.lvm_type = auto {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.num_shell_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.replication_device = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.report_discard_supported = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.reserved_percentage = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.target_helper = tgtadm {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.target_ip_address = 192.168.122.224 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.target_port = 3260 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.target_protocol = iscsi {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.trace_flags = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.unique_fqdn_network = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.use_chap_auth = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volume_backend_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volume_clear = zero {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volume_clear_ionice = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volume_clear_size = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_reports.file_event_handler = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_reports.log_dir = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.backend_host = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.chap_password = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.chap_username = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.disk_geometry = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.driver_client_cert = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.extra_capabilities = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.filter_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.goodness_function = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.iser_helper = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.iser_ip_address = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.iser_port = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.lvm_share_target = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.lvm_type = auto {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.num_shell_tries = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.replication_device = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.report_discard_supported = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.reserved_percentage = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.scst_target_driver = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.storage_protocol = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.target_helper = lioadm {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.target_ip_address = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.target_port = 3260 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.trace_flags = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.use_chap_auth = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volume_clear = zero {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volume_clear_size = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] lvmdriver-1.volumes_dir = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_notifications.driver = [] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_notifications.retry = -1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] key_manager.fixed_key = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.barbican_api_version = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.barbican_endpoint = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.barbican_endpoint_type = public {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.barbican_region_name = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.collect_timing = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.number_of_retries = 60 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.retry_delay = 1 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.send_service_user_token = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.verify_ssl = True {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican.verify_ssl_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican_service_user.auth_section = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican_service_user.auth_type = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican_service_user.cafile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican_service_user.certfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican_service_user.collect_timing = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican_service_user.insecure = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican_service_user.keyfile = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican_service_user.split_loggers = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] barbican_service_user.timeout = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.approle_role_id = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.approle_secret_id = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.auth_method = approle {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.auth_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.kv_mountpoint = secret {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.kv_path = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.kv_version = 2 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.namespace = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.root_token_id = **** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.ssl_ca_crt_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.timeout = 60.0 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.token_file = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.token_role = None {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.use_ssl = False {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:47:07 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] ******************************************************************************** {{(pid=82598) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 18:47:07 devstack sudo[82757]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:07 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.354s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:07 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:07 devstack sudo[82866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:47:07 devstack sudo[82866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:08 devstack sudo[82866]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.312s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 18:47:08 devstack cinder-volume[82753]: INFO cinder.brick.local_dev.lvm [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:08 devstack sudo[82955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 18:47:08 devstack sudo[82955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:08 devstack sudo[82955]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG cinder.brick.local_dev.lvm [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82753) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:08 devstack sudo[83043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:47:08 devstack sudo[83043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:08 devstack sudo[83043]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:08 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:08 devstack sudo[83223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:47:08 devstack sudo[83223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:09 devstack sudo[83223]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:09 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:09 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:09 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:09 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:09 devstack sudo[83321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 26 18:47:09 devstack sudo[83321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:09 devstack sudo[83321]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:09 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.297s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:09 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:09 devstack sudo[83372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 18:47:09 devstack sudo[83372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:09 devstack sudo[83372]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:09 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:09 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:09 devstack sudo[83385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 18:47:09 devstack sudo[83385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:10 devstack sudo[83385]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:10 devstack sudo[83459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:47:10 devstack sudo[83459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:10 devstack sudo[83459]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:10 devstack sudo[83468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:47:10 devstack sudo[83468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:10 devstack sudo[83468]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:10 devstack sudo[83552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:47:10 devstack sudo[83552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:10 devstack sudo[83552]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:10 devstack cinder-volume[82753]: INFO cinder.volume.drivers.lvm [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 26 18:47:10 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:11 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:11 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:11 devstack sudo[83556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:47:11 devstack sudo[83556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:11 devstack sudo[83556]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:11 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:11 devstack cinder-volume[82753]: DEBUG cinder.volume.drivers.lvm [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Updating volume stats {{(pid=82753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 18:47:11 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:11 devstack sudo[83565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 18:47:11 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:11 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:11 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:11 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:11 devstack sudo[83568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:47:11 devstack sudo[83568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:11 devstack sudo[83568]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:11 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:11 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:11 devstack sudo[83571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:47:11 devstack sudo[83571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:12 devstack sudo[83571]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:12 devstack sudo[83574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:47:12 devstack sudo[83574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:12 devstack sudo[83574]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:12 devstack cinder-volume[82753]: INFO cinder.volume.driver [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG cinder.volume.driver [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82753) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG oslo_db.sqlalchemy.engines [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG dbcounter [-] [82753] Writer thread running {{(pid=82753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG cinder.db.api [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Building query based on filter {{(pid=82753) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG cinder.image.image_utils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82753) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 18:47:12 devstack cinder-volume[82753]: INFO cinder.keymgr.migration [None req-089be5da-e480-4fc4-9c59-9b6337c69730 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG cinder.volume.drivers.lvm [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Updating volume stats {{(pid=82753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:12 devstack sudo[83577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 18:47:12 devstack sudo[83577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:12 devstack sudo[83577]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:12 devstack sudo[83582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:47:12 devstack sudo[83582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:12 devstack sudo[83582]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:12 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:12 devstack sudo[83585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:47:12 devstack sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:13 devstack sudo[83585]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:13 devstack sudo[83588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:47:13 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:13 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG cinder.manager [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Notifying Schedulers of capabilities ... {{(pid=82753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:47:13 devstack cinder-volume[82753]: INFO cinder.volume.manager [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Driver initialization completed successfully. Aug 26 18:47:13 devstack cinder-volume[82753]: INFO cinder.manager [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Initiating service 2 cleanup Aug 26 18:47:13 devstack cinder-volume[82753]: INFO cinder.manager [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Service 2 cleanup completed. Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG cinder.service [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Creating RPC server for service cinder-volume {{(pid=82753) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG cinder.service [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82753) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 18:47:13 devstack cinder-volume[82753]: INFO cinder.volume.manager [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG cinder.volume.drivers.lvm [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Updating volume stats {{(pid=82753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:13 devstack sudo[83592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 18:47:13 devstack sudo[83592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:13 devstack sudo[83592]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:13 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:13 devstack sudo[83595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:47:13 devstack sudo[83595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:14 devstack sudo[83595]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:14 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:14 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:14 devstack sudo[83600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:47:14 devstack sudo[83600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:14 devstack sudo[83600]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:14 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:14 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:47:14 devstack sudo[83606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:47:14 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:47:14 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root Aug 26 18:47:14 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.231s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:47:14 devstack cinder-volume[82753]: INFO cinder.volume.manager [None req-aba26aab-fe6c-46e1-8424-abb26075add4 None None] Driver post RPC initialization completed successfully. Aug 26 18:47:17 devstack cinder-volume[82598]: DEBUG dbcounter [-] [82598] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82598) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:47:24 devstack cinder-volume[82753]: DEBUG dbcounter [-] [82753] Writing DB stats cinder:SELECT=3 {{(pid=82753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:47:24 devstack cinder-volume[82753]: DEBUG dbcounter [-] [82753] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:47:39 devstack cinder-volume[82753]: DEBUG oslo_service.periodic_task [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running periodic task VolumeManager._thread_info {{(pid=82753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:47:39 devstack cinder-volume[82753]: DEBUG cinder.volume.manager [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] thread count: 6 {{(pid=82753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:47:39 devstack cinder-volume[82753]: DEBUG cinder.volume.manager [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] thread info: [<_MainThread(MainThread, started 138395600552064)>, , , , , ] {{(pid=82753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:48:39 devstack cinder-volume[82753]: DEBUG oslo_service.periodic_task [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:48:39 devstack cinder-volume[82753]: DEBUG cinder.volume.drivers.lvm [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Updating volume stats {{(pid=82753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 18:48:39 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:48:39 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 18:48:39 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:48:40 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:48:40 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:48:40 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:48:40 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:48:40 devstack sudo[86284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:48:40 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:48:40 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:48:40 devstack sudo[86287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:48:40 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:48:40 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG cinder.manager [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Notifying Schedulers of capabilities ... {{(pid=82753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG oslo_service.periodic_task [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running periodic task VolumeManager._thread_info {{(pid=82753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG cinder.volume.manager [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] thread count: 6 {{(pid=82753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:48:40 devstack cinder-volume[82753]: DEBUG cinder.volume.manager [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] thread info: [<_MainThread(MainThread, started 138395600552064)>, , , , , ] {{(pid=82753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:49:24 devstack cinder-volume[82753]: DEBUG dbcounter [-] [82753] Writing DB stats cinder:SELECT=1 {{(pid=82753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:49:24 devstack cinder-volume[82753]: DEBUG dbcounter [-] [82753] Writing DB stats cinder:UPDATE=1 {{(pid=82753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:49:39 devstack cinder-volume[82753]: DEBUG oslo_service.periodic_task [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:49:39 devstack cinder-volume[82753]: DEBUG cinder.volume.drivers.lvm [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Updating volume stats {{(pid=82753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 18:49:39 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:49:39 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 18:49:39 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:49:39 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Aug 26 18:49:39 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:49:39 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:49:39 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:49:39 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:49:40 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Aug 26 18:49:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:49:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:49:40 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:49:40 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:49:40 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Aug 26 18:49:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:49:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:49:40 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:49:40 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:49:40 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Aug 26 18:49:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:49:40 devstack cinder-volume[82753]: DEBUG cinder.manager [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Notifying Schedulers of capabilities ... {{(pid=82753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:50:39 devstack cinder-volume[82753]: DEBUG oslo_service.periodic_task [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:50:39 devstack cinder-volume[82753]: DEBUG cinder.volume.drivers.lvm [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Updating volume stats {{(pid=82753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 18:50:39 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:50:39 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 18:50:39 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:50:39 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Aug 26 18:50:39 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:50:39 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:50:40 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:50:40 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:50:40 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Aug 26 18:50:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:50:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:50:40 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 18:50:40 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:50:40 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Aug 26 18:50:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:50:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:50:40 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 18:50:40 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:50:40 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Aug 26 18:50:40 devstack cinder-volume[82753]: DEBUG oslo_concurrency.processutils [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=82753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:50:40 devstack cinder-volume[82753]: DEBUG cinder.manager [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Notifying Schedulers of capabilities ... {{(pid=82753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:50:40 devstack cinder-volume[82753]: DEBUG oslo_service.periodic_task [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] Running periodic task VolumeManager._thread_info {{(pid=82753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:50:40 devstack cinder-volume[82753]: DEBUG cinder.volume.manager [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] thread count: 6 {{(pid=82753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:50:40 devstack cinder-volume[82753]: DEBUG cinder.volume.manager [None req-d946a86b-bf34-4712-85a4-52b63a83ded3 None None] thread info: [<_MainThread(MainThread, started 138395600552064)>, , , , , ] {{(pid=82753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:51:24 devstack cinder-volume[82753]: DEBUG dbcounter [-] [82753] Writing DB stats cinder:SELECT=1 {{(pid=82753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:51:24 devstack cinder-volume[82753]: DEBUG dbcounter [-] [82753] Writing DB stats cinder:UPDATE=1 {{(pid=82753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:51:34 devstack cinder-volume[82598]: INFO oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Caught SIGTERM, stopping children Aug 26 18:51:34 devstack cinder-volume[82598]: DEBUG oslo_concurrency.lockutils [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Acquiring lock "singleton_lock" {{(pid=82598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 18:51:34 devstack cinder-volume[82598]: DEBUG oslo_concurrency.lockutils [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Acquired lock "singleton_lock" {{(pid=82598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 18:51:34 devstack cinder-volume[82598]: DEBUG oslo_concurrency.lockutils [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Releasing lock "singleton_lock" {{(pid=82598) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 18:51:34 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Stop services. {{(pid=82598) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 18:51:34 devstack cinder-volume[82598]: DEBUG oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Killing children. {{(pid=82598) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 18:51:34 devstack cinder-volume[82598]: INFO oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Waiting on 1 children to exit Aug 26 18:51:38 devstack cinder-volume[82753]: DEBUG oslo_concurrency.lockutils [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Acquiring lock "singleton_lock" {{(pid=82753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 18:51:38 devstack cinder-volume[82753]: DEBUG oslo_concurrency.lockutils [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Acquired lock "singleton_lock" {{(pid=82753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 18:51:38 devstack cinder-volume[82753]: DEBUG oslo_concurrency.lockutils [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Releasing lock "singleton_lock" {{(pid=82753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 18:51:38 devstack cinder-volume[82753]: WARNING amqp [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 18:51:38 devstack cinder-volume[82753]: WARNING amqp [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 18:51:38 devstack cinder-volume[82598]: INFO oslo_service.backend._eventlet.service [None req-2b804b23-9f6a-4aab-804e-02195c5f0278 None None] Child 82753 exited with status 0 Aug 26 18:51:39 devstack cinder-volume[92868]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 18:51:39 devstack cinder-volume[92868]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 18:51:39 devstack cinder-volume[92868]: we strongly recommend against using it for new projects. Aug 26 18:51:39 devstack cinder-volume[92868]: If you are already using Eventlet, we recommend migrating to a different Aug 26 18:51:39 devstack cinder-volume[92868]: framework. For more detail see Aug 26 18:51:39 devstack cinder-volume[92868]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 18:51:39 devstack cinder-volume[92868]: import eventlet # noqa Aug 26 18:51:41 devstack cinder-volume[92868]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92868) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 18:51:41 devstack cinder-volume[92868]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92868) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 18:51:41 devstack cinder-volume[92868]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92868) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 18:51:41 devstack cinder-volume[92868]: INFO dbcounter [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Registered counter for database cinder Aug 26 18:51:41 devstack cinder-volume[92868]: DEBUG oslo_db.sqlalchemy.engines [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG dbcounter [-] [92868] Writer thread running {{(pid=92868) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 18:51:42 devstack cinder-volume[92868]: INFO cinder.rpc [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 18:51:42 devstack cinder-volume[92868]: INFO cinder.rpc [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_db.sqlalchemy.engines [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:51:42 devstack cinder-volume[92868]: INFO cinder.volume.manager [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Determined volume DB was empty at startup. Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG cinder.volume.manager [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92868) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 18:51:42 devstack cinder-volume[92868]: INFO cinder.volume.manager [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 18:51:42 devstack cinder-volume[92868]: WARNING stevedore.named [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 18:51:42 devstack cinder-volume[92868]: WARNING castellan.key_manager [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 18:51:42 devstack cinder-volume[92868]: WARNING cinder.keymgr.conf_key_mgr [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 18:51:42 devstack cinder-volume[92868]: INFO cinder.volume.manager [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_db.sqlalchemy.engines [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:51:42 devstack cinder-volume[92868]: INFO oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Starting 1 workers Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Started child 93084 {{(pid=92868) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Full set of CONF: {{(pid=92868) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] ******************************************************************************** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Configuration options gathered from: {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] ================================================================================ {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] allow_availability_zone_fallback = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] allow_compression_on_image_upload = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] allowed_direct_url_schemes = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] api_rate_limit = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] auth_strategy = keystone {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_availability_zone = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[93084]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_host = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_stats_polling_interval = 60 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backup_api_class = cinder.backup.api.API {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backup_name_template = backup-%s {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backup_use_same_host = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backup_use_temp_snapshot = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] chap_password = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] chap_username = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cinder_internal_tenant_project_id = 5fc3e78795c442d1b5c977d018386361 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cinder_internal_tenant_user_id = 9c87c130ccf742a0b3c7e43f3929cb5a {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cluster = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] compression_format = gzip {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] compute_api_class = cinder.compute.nova.API {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] config_dir = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] config_source = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] control_exchange = openstack {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] debug = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] default_availability_zone = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] default_group_type = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] default_volume_type = QuobyteHD {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] disk_geometry = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] driver_client_cert = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] driver_client_cert_key = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] driver_data_namespace = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] driver_ssl_cert_path = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] driver_ssl_cert_verify = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] driver_use_ssl = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] enable_new_services = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] enable_unsupported_driver = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] enabled_backends = ['QuobyteHD'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] enforce_multipath_for_image_xfer = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] filter_function = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_api_insecure = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_api_servers = ['http://192.168.122.224/image'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_api_ssl_compression = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_ca_certificates_file = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_catalog_info = image:glance:publicURL {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_certfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_keyfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_num_retries = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance_request_timeout = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] goodness_function = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] graceful_shutdown_timeout = 5 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] group_api_class = cinder.group.api.API {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] host = devstack {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_compress_on_upload = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_conversion_address_space_limit = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_conversion_cpu_limit = 60 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_conversion_disable = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_upload_use_cinder_backend = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_upload_use_internal_tenant = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_volume_cache_enabled = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_volume_cache_max_count = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] image_volume_cache_max_size_gb = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] init_host_max_objects_retrieval = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] instance_format = [instance: %(uuid)s] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] iscsi_target_flags = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] iscsi_write_cache = on {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] iser_helper = tgtadm {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] iser_ip_address = 192.168.122.224 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] iser_port = 3260 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] log_color = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] log_config_append = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] log_dir = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] log_file = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] log_options = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] log_rotate_interval = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] log_rotate_interval_type = days {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] log_rotation_type = none {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] max_age = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] max_logfile_count = 30 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] max_logfile_size_mb = 200 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] max_over_subscription_ratio = 20.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] message_reap_interval = 86400 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] message_ttl = 2592000 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] migration_create_volume_timeout_secs = 300 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] monkey_patch = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] monkey_patch_modules = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] my_ip = 192.168.122.224 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] no_snapshot_gb_quota = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] num_iser_scan_tries = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] num_shell_tries = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] num_volume_device_scan_tries = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[93084]: INFO cinder.volume.manager [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] nvmeof_conn_info_version = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] nvmet_ns_id = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] nvmet_port_id = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] osapi_max_limit = 1000 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] osapi_volume_ext_list = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] osapi_volume_listen = 0.0.0.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] osapi_volume_listen_port = 8776 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] osapi_volume_use_ssl = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] osapi_volume_workers = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] per_volume_size_limit = -1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] periodic_fuzzy_delay = 60 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] periodic_interval = 60 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] project_id_regex = [0-9a-f\-]+ {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] public_endpoint = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.remotefs [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93084) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] publish_errors = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] quota_backup_gigabytes = 1000 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] quota_backups = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] quota_gigabytes = 1000 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] quota_groups = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] quota_snapshots = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] quota_volumes = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] rate_limit_burst = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] rate_limit_except_level = CRITICAL {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] rate_limit_interval = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] reinit_driver_count = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] replication_device = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] report_discard_supported = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] report_interval = 120 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] reservation_clean_interval = 86400 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] reservation_expire = 86400 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] reserved_image_namespaces = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] reserved_percentage = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] rpc_response_timeout = 120 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] run_external_periodic_tasks = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] scst_target_driver = iscsi {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] scst_target_iqn_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_down_time = 720 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] shell_completion = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] snapshot_name_template = snapshot-%s {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] split_loggers = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] state_path = /opt/stack/data/cinder {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] storage_availability_zone = nova {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] storage_protocol = iSCSI {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] syslog_log_facility = LOG_USER {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] target_helper = lioadm {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] target_ip_address = 192.168.122.224 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] target_port = 3260 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] target_protocol = iscsi {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] target_secondary_ip_addresses = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] trace_flags = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] transfer_api_class = cinder.transfer.api.API {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] transport_url = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] until_refresh = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] use_chap_auth = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] use_default_quota_class = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] use_journal = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] use_json = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] use_multipath_for_image_xfer = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] use_stderr = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] use_syslog = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] verify_glance_signatures = enabled {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_api_class = cinder.volume.api.API {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_backend_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_clear = zero {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_clear_ionice = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_clear_size = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_copy_bps_limit = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_dd_blocksize = 1M {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_name_template = volume-%s {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_service_inithost_offload = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volume_usage_audit_period = month {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] zoning_mode = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_concurrency.disable_process_locking = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.auth_section = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.auth_type = password {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.auth_version = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.cache = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.certfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.delay_auth_decision = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.http_connect_timeout = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.include_service_catalog = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.insecure = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.interface = public {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.keyfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_password = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcache_username = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.region_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.service_token_roles_required = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.service_type = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.token_cache_time = 300 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.224/identity {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.backend = dogpile.cache.null {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.backend_argument = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.backend_expiration_time = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.config_prefix = cache.oslo {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.debug_cache_backend = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.enable_retry_client = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.enable_socket_keepalive = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.enabled = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.expiration_time = 600 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.hashclient_retry_attempts = 2 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.memcache_dead_retry = 300 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.memcache_pool_maxsize = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.memcache_sasl_enabled = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.password = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.proxies = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.redis_db = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.redis_sentinel_service_name = mymaster {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.redis_server = localhost:6379 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.retry_attempts = 2 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.retry_delay = 0.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.socket_keepalive_count = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.socket_keepalive_idle = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.socket_keepalive_interval = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.socket_timeout = 1.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.tls_allowed_ciphers = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.tls_cafile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.tls_certfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.tls_enabled = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.tls_keyfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cache.username = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] coordination.backend_url = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.asyncio_connection = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.asyncio_slave_connection = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.backend = sqlalchemy {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.connection = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.connection_debug = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.connection_parameters = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.connection_recycle_time = 3600 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.connection_trace = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.db_inc_retry_interval = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.db_max_retries = 20 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.db_max_retry_interval = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.db_retry_interval = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.max_overflow = 50 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.max_pool_size = 5 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.max_retries = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.mysql_wsrep_sync_wait = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.pool_timeout = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.retry_interval = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.slave_connection = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.sqlite_synchronous = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.synchronous_reader = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] database.use_db_reconnect = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.connection_string = messaging:// {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.enabled = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.es_doc_type = notification {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.es_scroll_size = 10000 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.es_scroll_time = 2m {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.filter_error_trace = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.hmac_keys = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.sentinel_service_name = mymaster {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.socket_timeout = 0.1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.trace_requests = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler.trace_sqlalchemy = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler_jaeger.process_tags = {} {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler_jaeger.service_name_prefix = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] profiler_otlp.service_name_prefix = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.enforce_new_defaults = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93084) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 18:51:42 devstack cinder-volume[93084]: WARNING cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 18:51:42 devstack cinder-volume[93084]: WARNING cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.policy_default_rule = default {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Running cmd (subprocess): mount.quobyte {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.policy_file = policy.yaml {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_policy.remote_timeout = 60.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] privsep_osbrick.group = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] privsep_osbrick.helper_command = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] privsep_osbrick.user = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cinder_sys_admin.group = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cinder_sys_admin.helper_command = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] cinder_sys_admin.user = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.auth_section = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.auth_type = password {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.cafile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.certfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.collect_timing = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.insecure = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.keyfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.send_service_user_token = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.split_loggers = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] service_user.timeout = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.auth_section = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.auth_type = password {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.certfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.collect_timing = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.insecure = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.keyfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.region_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.split_loggers = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] glance.timeout = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.backend_availability_zone = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.chap_password = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.chap_username = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.disk_geometry = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.driver_client_cert = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.driver_client_cert_key = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.driver_data_namespace = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.driver_use_ssl = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.enable_unsupported_driver = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.extra_capabilities = {} {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.filter_function = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.goodness_function = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.iscsi_target_flags = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.iscsi_write_cache = on {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.iser_helper = tgtadm {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.iser_ip_address = 192.168.122.224 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.iser_port = 3260 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_host = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_login = admin {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_mount_options = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_password = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_private_key = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_share_path = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_ssh_port = 22 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.num_shell_tries = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.nvmet_port_id = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.quobyte_client_cfg = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.quobyte_volume_url = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.replication_device = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.report_discard_supported = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.reserved_percentage = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.scst_target_driver = iscsi {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.scst_target_iqn_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.storage_protocol = iSCSI {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.target_helper = tgtadm {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.target_ip_address = 192.168.122.224 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.target_port = 3260 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.target_protocol = iscsi {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.trace_flags = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.unique_fqdn_network = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.use_chap_auth = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.volume_backend_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.volume_clear = zero {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.volume_clear_ionice = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.volume_clear_size = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_reports.file_event_handler = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_reports.log_dir = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.backend_availability_zone = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.backend_host = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.chap_password = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.chap_username = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.chiscsi_conf = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.disk_geometry = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.driver_client_cert = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.driver_client_cert_key = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.driver_data_namespace = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.driver_use_ssl = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.enable_unsupported_driver = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.extra_capabilities = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.filter_function = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.goodness_function = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.iscsi_target_flags = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.iscsi_write_cache = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.iser_helper = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.iser_ip_address = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.iser_port = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.iser_target_prefix = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_host = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_login = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_mount_options = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_password = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_private_key = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_share_path = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_ssh_port = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.num_shell_tries = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nvmet_ns_id = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.nvmet_port_id = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.replication_device = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.report_discard_supported = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.reserved_percentage = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.scst_target_driver = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.storage_protocol = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.target_helper = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.target_ip_address = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.target_port = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.target_prefix = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.target_protocol = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.trace_flags = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.unique_fqdn_network = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack quobyte-client[93085]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 18:51:42 devstack quobyte-client[93085]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.use_chap_auth = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.volume_clear = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.volume_clear_ionice = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.volume_clear_size = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] CMD "mount.quobyte" returned: 1 in 0.136s {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] QuobyteHD.volumes_dir = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:51:42 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[93084]: INFO cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 ... Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 -c /etc/quobyte/client-cinder.cfg {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.ssl = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.ssl_version = {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_notifications.driver = [] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_notifications.retry = -1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] oslo_messaging_notifications.transport_url = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] key_manager.fixed_key = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.barbican_api_version = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.barbican_endpoint = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.barbican_endpoint_type = public {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.barbican_region_name = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.cafile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.certfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.collect_timing = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.insecure = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.keyfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.number_of_retries = 60 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.retry_delay = 1 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.send_service_user_token = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.split_loggers = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.timeout = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.verify_ssl = True {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican.verify_ssl_path = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican_service_user.auth_section = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican_service_user.auth_type = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican_service_user.cafile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican_service_user.certfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican_service_user.collect_timing = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican_service_user.insecure = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican_service_user.keyfile = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican_service_user.split_loggers = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] barbican_service_user.timeout = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.approle_role_id = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.approle_secret_id = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.auth_method = approle {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.auth_path = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.kv_mountpoint = secret {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.kv_path = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.kv_version = 2 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.namespace = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.root_token_id = **** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.ssl_ca_crt_file = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.timeout = 60.0 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.token_file = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.token_role = None {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.use_ssl = False {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:42 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] ******************************************************************************** {{(pid=92868) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 18:51:42 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 -c /etc/quobyte/client-cinder.cfg Aug 26 18:51:42 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:51:43 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.397s {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:43 devstack cinder-volume[93084]: INFO cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 succeeded Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.411s {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:43 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:51:43 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:51:43 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.233s {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:43 devstack cinder-volume[93084]: INFO cinder.volume.driver [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.volume.driver [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.7907447814941, 'free_capacity_gb': 1774.7907447814941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93084) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_db.sqlalchemy.engines [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93084) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG dbcounter [-] [93084] Writer thread running {{(pid=93084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.db.api [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Building query based on filter {{(pid=93084) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.image.image_utils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93084) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 18:51:43 devstack cinder-volume[93084]: INFO cinder.keymgr.migration [None req-dc3ffce1-d743-4470-a28a-f7d77cba4dad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:43 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:51:43 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:51:43 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.221s {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.manager [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Notifying Schedulers of capabilities ... {{(pid=93084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:51:43 devstack cinder-volume[93084]: INFO cinder.volume.manager [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Driver initialization completed successfully. Aug 26 18:51:43 devstack cinder-volume[93084]: INFO cinder.manager [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Initiating service 3 cleanup Aug 26 18:51:43 devstack cinder-volume[93084]: INFO cinder.manager [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Service 3 cleanup completed. Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.service [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Creating RPC server for service cinder-volume {{(pid=93084) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.service [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93084) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 18:51:43 devstack cinder-volume[93084]: INFO cinder.volume.manager [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.quobyte [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:51:43 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:44 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:51:44 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:51:44 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Aug 26 18:51:44 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.269s {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:44 devstack cinder-volume[93084]: INFO cinder.volume.manager [None req-3a3edea2-2538-4043-a5d1-051661581241 None None] Driver post RPC initialization completed successfully. Aug 26 18:51:48 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-d8eff482-9b34-4453-a9e2-342cc3ae983d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:51:48 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-d8eff482-9b34-4453-a9e2-342cc3ae983d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:51:48 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.quobyte [None req-d8eff482-9b34-4453-a9e2-342cc3ae983d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93084) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:51:48 devstack cinder-volume[93084]: DEBUG cinder.volume.drivers.quobyte [None req-d8eff482-9b34-4453-a9e2-342cc3ae983d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93084) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:51:48 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-d8eff482-9b34-4453-a9e2-342cc3ae983d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93084) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:51:48 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-d8eff482-9b34-4453-a9e2-342cc3ae983d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:48 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:51:48 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:51:48 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Aug 26 18:51:48 devstack cinder-volume[93084]: DEBUG oslo_concurrency.processutils [None req-d8eff482-9b34-4453-a9e2-342cc3ae983d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.235s {{(pid=93084) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:48 devstack cinder-volume[93084]: DEBUG cinder.manager [None req-d8eff482-9b34-4453-a9e2-342cc3ae983d None None] Notifying Schedulers of capabilities ... {{(pid=93084) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:51:49 devstack cinder-volume[92868]: INFO oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Caught SIGTERM, stopping children Aug 26 18:51:49 devstack cinder-volume[92868]: DEBUG oslo_concurrency.lockutils [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Acquiring lock "singleton_lock" {{(pid=92868) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 18:51:49 devstack cinder-volume[92868]: DEBUG oslo_concurrency.lockutils [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Acquired lock "singleton_lock" {{(pid=92868) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 18:51:49 devstack cinder-volume[92868]: DEBUG oslo_concurrency.lockutils [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Releasing lock "singleton_lock" {{(pid=92868) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 18:51:49 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Stop services. {{(pid=92868) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 18:51:49 devstack cinder-volume[92868]: DEBUG oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Killing children. {{(pid=92868) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 18:51:49 devstack cinder-volume[92868]: INFO oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Waiting on 1 children to exit Aug 26 18:51:52 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Acquiring lock "singleton_lock" {{(pid=93084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 18:51:52 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Acquired lock "singleton_lock" {{(pid=93084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 18:51:52 devstack cinder-volume[93084]: DEBUG oslo_concurrency.lockutils [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Releasing lock "singleton_lock" {{(pid=93084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 18:51:52 devstack cinder-volume[93084]: WARNING amqp [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 18:51:52 devstack cinder-volume[93084]: WARNING amqp [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 18:51:52 devstack cinder-volume[92868]: INFO oslo_service.backend._eventlet.service [None req-fa3bfae5-215f-416c-bdbb-9a16dca6eddf None None] Child 93084 exited with status 0 Aug 26 18:51:52 devstack cinder-volume[93371]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 18:51:52 devstack cinder-volume[93371]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 18:51:52 devstack cinder-volume[93371]: we strongly recommend against using it for new projects. Aug 26 18:51:52 devstack cinder-volume[93371]: If you are already using Eventlet, we recommend migrating to a different Aug 26 18:51:52 devstack cinder-volume[93371]: framework. For more detail see Aug 26 18:51:52 devstack cinder-volume[93371]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 18:51:52 devstack cinder-volume[93371]: import eventlet # noqa Aug 26 18:51:55 devstack cinder-volume[93371]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93371) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 18:51:55 devstack cinder-volume[93371]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93371) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 18:51:55 devstack cinder-volume[93371]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93371) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 18:51:56 devstack cinder-volume[93371]: INFO dbcounter [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Registered counter for database cinder Aug 26 18:51:56 devstack cinder-volume[93371]: DEBUG oslo_db.sqlalchemy.engines [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93371) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG dbcounter [-] [93371] Writer thread running {{(pid=93371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 18:51:57 devstack cinder-volume[93371]: INFO cinder.rpc [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 18:51:57 devstack cinder-volume[93371]: INFO cinder.rpc [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_db.sqlalchemy.engines [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93371) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:51:57 devstack cinder-volume[93371]: INFO cinder.volume.manager [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Determined volume DB was empty at startup. Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG cinder.volume.manager [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93371) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 18:51:57 devstack cinder-volume[93371]: WARNING stevedore.named [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 18:51:57 devstack cinder-volume[93371]: WARNING castellan.key_manager [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 18:51:57 devstack cinder-volume[93371]: WARNING cinder.keymgr.conf_key_mgr [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 18:51:57 devstack cinder-volume[93371]: INFO cinder.volume.manager [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_db.sqlalchemy.engines [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93371) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:51:57 devstack cinder-volume[93371]: INFO oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Starting 1 workers Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Started child 93671 {{(pid=93371) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Full set of CONF: {{(pid=93371) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] ******************************************************************************** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] Configuration options gathered from: {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] ================================================================================ {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] allow_availability_zone_fallback = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93671]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] allow_compression_on_image_upload = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] allowed_direct_url_schemes = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] api_rate_limit = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] auth_strategy = keystone {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_availability_zone = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_host = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_stats_polling_interval = 60 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backup_api_class = cinder.backup.api.API {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backup_name_template = backup-%s {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backup_use_same_host = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backup_use_temp_snapshot = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] chap_password = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] chap_username = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cinder_internal_tenant_project_id = 5fc3e78795c442d1b5c977d018386361 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cinder_internal_tenant_user_id = 9c87c130ccf742a0b3c7e43f3929cb5a {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cluster = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] compression_format = gzip {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] compute_api_class = cinder.compute.nova.API {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] config_dir = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] config_source = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] control_exchange = openstack {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] debug = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] default_availability_zone = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] default_group_type = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] default_volume_type = QuobyteHD {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] disk_geometry = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] driver_client_cert = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] driver_client_cert_key = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] driver_data_namespace = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] driver_ssl_cert_path = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] driver_ssl_cert_verify = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] driver_use_ssl = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] enable_new_services = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] enable_unsupported_driver = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] enabled_backends = ['QuobyteHD'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] enforce_multipath_for_image_xfer = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] filter_function = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_api_insecure = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_api_servers = ['http://192.168.122.224/image'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_api_ssl_compression = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_ca_certificates_file = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_catalog_info = image:glance:publicURL {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_certfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_keyfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_num_retries = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance_request_timeout = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] goodness_function = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] graceful_shutdown_timeout = 5 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] group_api_class = cinder.group.api.API {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] host = devstack {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_compress_on_upload = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_conversion_address_space_limit = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_conversion_cpu_limit = 60 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_conversion_disable = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_upload_use_cinder_backend = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_upload_use_internal_tenant = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_volume_cache_enabled = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_volume_cache_max_count = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] image_volume_cache_max_size_gb = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] init_host_max_objects_retrieval = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] instance_format = [instance: %(uuid)s] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] iscsi_target_flags = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] iscsi_write_cache = on {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] iser_helper = tgtadm {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] iser_ip_address = 192.168.122.224 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] iser_port = 3260 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] log_color = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] log_config_append = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] log_dir = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] log_file = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] log_options = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] log_rotate_interval = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] log_rotate_interval_type = days {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] log_rotation_type = none {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] max_age = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] max_logfile_count = 30 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] max_logfile_size_mb = 200 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] max_over_subscription_ratio = 20.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] message_reap_interval = 86400 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] message_ttl = 2592000 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] migration_create_volume_timeout_secs = 300 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] monkey_patch = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] monkey_patch_modules = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] my_ip = 192.168.122.224 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] no_snapshot_gb_quota = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] num_iser_scan_tries = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] num_shell_tries = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] num_volume_device_scan_tries = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] nvmeof_conn_info_version = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] nvmet_ns_id = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] nvmet_port_id = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] osapi_max_limit = 1000 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] osapi_volume_ext_list = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] osapi_volume_listen = 0.0.0.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] osapi_volume_listen_port = 8776 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] osapi_volume_use_ssl = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] osapi_volume_workers = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93671) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] per_volume_size_limit = -1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] periodic_fuzzy_delay = 60 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] periodic_interval = 60 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] project_id_regex = [0-9a-f\-]+ {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] public_endpoint = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] publish_errors = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] quota_backup_gigabytes = 1000 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] quota_backups = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] quota_gigabytes = 1000 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] quota_groups = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] quota_snapshots = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] quota_volumes = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] rate_limit_burst = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] rate_limit_except_level = CRITICAL {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] rate_limit_interval = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] reinit_driver_count = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] replication_device = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] report_discard_supported = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] report_interval = 120 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] reservation_clean_interval = 86400 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] reservation_expire = 86400 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] reserved_image_namespaces = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] reserved_percentage = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] rpc_response_timeout = 120 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] run_external_periodic_tasks = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] scst_target_driver = iscsi {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] scst_target_iqn_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_down_time = 720 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] shell_completion = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] snapshot_name_template = snapshot-%s {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] split_loggers = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] state_path = /opt/stack/data/cinder {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] storage_availability_zone = nova {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] storage_protocol = iSCSI {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] syslog_log_facility = LOG_USER {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] target_helper = lioadm {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] target_ip_address = 192.168.122.224 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] target_port = 3260 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] target_protocol = iscsi {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] target_secondary_ip_addresses = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] trace_flags = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] transfer_api_class = cinder.transfer.api.API {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] transport_url = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] until_refresh = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] use_chap_auth = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] use_default_quota_class = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] use_journal = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] use_json = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] use_multipath_for_image_xfer = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] use_stderr = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] use_syslog = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] verify_glance_signatures = enabled {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_api_class = cinder.volume.api.API {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_backend_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_clear = zero {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_clear_ionice = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_clear_size = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_copy_bps_limit = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_dd_blocksize = 1M {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_name_template = volume-%s {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_service_inithost_offload = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volume_usage_audit_period = month {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] zoning_mode = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_concurrency.disable_process_locking = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.auth_section = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.auth_type = password {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.auth_version = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.cache = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.certfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.delay_auth_decision = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.http_connect_timeout = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.include_service_catalog = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.insecure = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.interface = public {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.keyfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_password = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcache_username = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.region_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.service_token_roles_required = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.service_type = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.token_cache_time = 300 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.224/identity {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.backend = dogpile.cache.null {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.backend_argument = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.backend_expiration_time = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.config_prefix = cache.oslo {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.debug_cache_backend = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.enable_retry_client = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.enable_socket_keepalive = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.enabled = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.expiration_time = 600 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.hashclient_retry_attempts = 2 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.memcache_dead_retry = 300 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.memcache_pool_maxsize = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.memcache_sasl_enabled = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.password = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.proxies = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.redis_db = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.redis_sentinel_service_name = mymaster {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.redis_server = localhost:6379 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.retry_attempts = 2 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.retry_delay = 0.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.socket_keepalive_count = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.socket_keepalive_idle = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.socket_keepalive_interval = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.socket_timeout = 1.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.tls_allowed_ciphers = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.tls_cafile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.tls_certfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.tls_enabled = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.tls_keyfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cache.username = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] coordination.backend_url = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.asyncio_connection = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.asyncio_slave_connection = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.backend = sqlalchemy {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.connection = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.connection_debug = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.connection_parameters = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.connection_recycle_time = 3600 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.connection_trace = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.db_inc_retry_interval = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.db_max_retries = 20 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.db_max_retry_interval = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.db_retry_interval = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.max_overflow = 50 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.max_pool_size = 5 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.max_retries = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.mysql_wsrep_sync_wait = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.pool_timeout = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.retry_interval = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.slave_connection = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.sqlite_synchronous = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.synchronous_reader = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] database.use_db_reconnect = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.connection_string = messaging:// {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.enabled = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.es_doc_type = notification {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.es_scroll_size = 10000 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.es_scroll_time = 2m {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.filter_error_trace = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.hmac_keys = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.sentinel_service_name = mymaster {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.socket_timeout = 0.1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.trace_requests = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler.trace_sqlalchemy = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler_jaeger.process_tags = {} {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler_jaeger.service_name_prefix = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] profiler_otlp.service_name_prefix = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.enforce_new_defaults = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.policy_default_rule = default {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.policy_file = policy.yaml {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_policy.remote_timeout = 60.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] privsep_osbrick.group = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] privsep_osbrick.helper_command = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] privsep_osbrick.user = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cinder_sys_admin.group = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cinder_sys_admin.helper_command = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] cinder_sys_admin.user = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.auth_section = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.auth_type = password {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.cafile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.certfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.collect_timing = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.insecure = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.keyfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.send_service_user_token = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.split_loggers = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] service_user.timeout = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93671) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.auth_section = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.auth_type = password {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.certfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.quobyte [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.collect_timing = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.insecure = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.keyfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.quobyte [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.region_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.split_loggers = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] glance.timeout = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.backend_availability_zone = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Running cmd (subprocess): mount.quobyte {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.chap_password = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.chap_username = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.disk_geometry = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.driver_client_cert = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.driver_client_cert_key = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.driver_data_namespace = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.driver_use_ssl = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.enable_unsupported_driver = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.extra_capabilities = {} {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.filter_function = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.goodness_function = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.iscsi_target_flags = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.iscsi_write_cache = on {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.iser_helper = tgtadm {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.iser_ip_address = 192.168.122.224 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.iser_port = 3260 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_host = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_login = admin {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_mount_options = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_password = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_private_key = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_share_path = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_ssh_port = 22 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.num_shell_tries = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.nvmet_port_id = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.quobyte_client_cfg = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.quobyte_volume_url = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.replication_device = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.report_discard_supported = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.reserved_percentage = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.scst_target_driver = iscsi {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.scst_target_iqn_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.storage_protocol = iSCSI {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.target_helper = tgtadm {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.target_ip_address = 192.168.122.224 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.target_port = 3260 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.target_protocol = iscsi {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.trace_flags = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.unique_fqdn_network = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.use_chap_auth = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.volume_backend_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.volume_clear = zero {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.volume_clear_ionice = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.volume_clear_size = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_reports.file_event_handler = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_reports.log_dir = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.backend_availability_zone = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.backend_host = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.chap_password = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.chap_username = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.chiscsi_conf = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.disk_geometry = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.driver_client_cert = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.driver_client_cert_key = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.driver_data_namespace = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.driver_use_ssl = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.extra_capabilities = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.filter_function = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.goodness_function = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.iscsi_target_flags = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.iscsi_write_cache = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.iser_helper = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.iser_ip_address = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.iser_port = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.iser_target_prefix = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_host = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_login = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_mount_options = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_password = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_private_key = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_share_path = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_ssh_port = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.num_shell_tries = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nvmet_ns_id = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.nvmet_port_id = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.replication_device = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.report_discard_supported = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.reserved_percentage = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.scst_target_driver = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.storage_protocol = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.target_helper = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.target_ip_address = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.target_port = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.target_prefix = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.target_protocol = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.trace_flags = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.unique_fqdn_network = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.use_chap_auth = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.volume_clear = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.volume_clear_ionice = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.volume_clear_size = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] QuobyteHD.volumes_dir = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.ssl = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.ssl_version = {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_notifications.driver = [] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_notifications.retry = -1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] oslo_messaging_notifications.transport_url = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] key_manager.fixed_key = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.barbican_api_version = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack quobyte-client[93672]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.barbican_endpoint = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.barbican_endpoint_type = public {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.barbican_region_name = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.cafile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.certfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.collect_timing = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.insecure = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack quobyte-client[93672]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.keyfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.number_of_retries = 60 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.retry_delay = 1 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.send_service_user_token = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.split_loggers = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.timeout = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.verify_ssl = True {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican.verify_ssl_path = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican_service_user.auth_section = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican_service_user.auth_type = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican_service_user.cafile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican_service_user.certfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican_service_user.collect_timing = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican_service_user.insecure = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican_service_user.keyfile = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican_service_user.split_loggers = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] barbican_service_user.timeout = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.approle_role_id = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.approle_secret_id = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.auth_method = approle {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.auth_path = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.kv_mountpoint = secret {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.kv_path = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.kv_version = 2 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.namespace = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.root_token_id = **** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.ssl_ca_crt_file = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.timeout = 60.0 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.token_file = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.token_role = None {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.use_ssl = False {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 18:51:57 devstack cinder-volume[93371]: DEBUG oslo_service.backend._eventlet.service [None req-507c756d-9085-4ade-8164-cfa7d0ca656a None None] ******************************************************************************** {{(pid=93371) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:57 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:51:57 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:51:57 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.229s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:57 devstack cinder-volume[93671]: INFO cinder.volume.driver [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG cinder.volume.driver [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.7907447814941, 'free_capacity_gb': 1774.7907447814941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93671) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_db.sqlalchemy.engines [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93671) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writer thread running {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG cinder.db.api [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Building query based on filter {{(pid=93671) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93671) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:51:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:57 devstack cinder-volume[93671]: INFO cinder.keymgr.migration [None req-bb3edf1c-bed3-411e-8db4-ea7e928d2696 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 18:51:57 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:51:57 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:51:58 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.226s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:51:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Driver initialization completed successfully. Aug 26 18:51:58 devstack cinder-volume[93671]: INFO cinder.manager [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Initiating service 3 cleanup Aug 26 18:51:58 devstack cinder-volume[93671]: INFO cinder.manager [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Service 3 cleanup completed. Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG cinder.service [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Creating RPC server for service cinder-volume {{(pid=93671) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG cinder.service [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93671) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 18:51:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:51:58 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:51:58 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:51:58 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Aug 26 18:51:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.242s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:51:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-abd27e2a-2c17-41b7-b348-f932375df3b3 None None] Driver post RPC initialization completed successfully. Aug 26 18:52:07 devstack cinder-volume[93371]: DEBUG dbcounter [-] [93371] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93371) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:52:08 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:52:08 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:52:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:52:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 6 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:52:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Flow 'volume_create_manager' (134d4ff4-f1ea-4e67-b923-710c49eb73d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d672301-36f2-44b2-9e3e-0ba3dba123a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d672301-36f2-44b2-9e3e-0ba3dba123a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1991751555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d77204-1870-4cab-83fe-08f63beb667a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6509ebf310c2474e80cec59e4d38a7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:52:57Z,use_quota=True,user_id='d9745a5dd27f429faaecb253e1f3a575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fab726-f811-4f47-bff4-6286e9c78b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fab726-f811-4f47-bff4-6286e9c78b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0c22a5-ec82-42de-aadc-6cc20e9409c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0c22a5-ec82-42de-aadc-6cc20e9409c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d77204-1870-4cab-83fe-08f63beb667a', 'volume_name': 'volume-d1d77204-1870-4cab-83fe-08f63beb667a', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1e9fdc-efdb-4c4c-a486-d07dea1f1389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1e9fdc-efdb-4c4c-a486-d07dea1f1389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2775044-cd8e-4111-9358-6ea8263fafa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:56 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Volume d1d77204-1870-4cab-83fe-08f63beb667a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d77204-1870-4cab-83fe-08f63beb667a', 'volume_size': 1} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1991751555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d77204-1870-4cab-83fe-08f63beb667a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6509ebf310c2474e80cec59e4d38a7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:52:57Z,use_quota=True,user_id='d9745a5dd27f429faaecb253e1f3a575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Creating volume d1d77204-1870-4cab-83fe-08f63beb667a {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:52:56 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:52:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:52:56 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a 1073741824 Aug 26 18:52:56 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:52:57 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a 1073741824" returned: 0 in 0.532s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:52:57 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a Aug 26 18:52:57 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Flow 'volume_create_manager' (1900e11b-d570-411a-b033-42c241afa8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af05db7-d253-4e39-bac7-8d9585ffc15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af05db7-d253-4e39-bac7-8d9585ffc15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-873758499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6421acf-7829-4f52-8600-3fb41aa5d75b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31e79ba8c4a5458cac40bed2f0d93d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:52:58Z,use_quota=True,user_id='0af727cc0f634a819c0743c25e8ba09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a751e423-1297-4ddf-8a81-b9230fb8aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a751e423-1297-4ddf-8a81-b9230fb8aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171484e0-e4af-405a-8ac5-65a215a2452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171484e0-e4af-405a-8ac5-65a215a2452a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6421acf-7829-4f52-8600-3fb41aa5d75b', 'volume_name': 'volume-b6421acf-7829-4f52-8600-3fb41aa5d75b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0c7f4e-d10b-4b6c-b0f4-33fc72935628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0c7f4e-d10b-4b6c-b0f4-33fc72935628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be169a6c-f0c8-4f3a-8175-3865e7dcb4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:57 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Volume b6421acf-7829-4f52-8600-3fb41aa5d75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6421acf-7829-4f52-8600-3fb41aa5d75b', 'volume_size': 1} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:52:57 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a" returned: 0 in 0.369s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-873758499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6421acf-7829-4f52-8600-3fb41aa5d75b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31e79ba8c4a5458cac40bed2f0d93d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:52:58Z,use_quota=True,user_id='0af727cc0f634a819c0743c25e8ba09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Creating volume b6421acf-7829-4f52-8600-3fb41aa5d75b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:52:57 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2775044-cd8e-4111-9358-6ea8263fafa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d77204-1870-4cab-83fe-08f63beb667a', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:57 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b 1073741824 Aug 26 18:52:57 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef89deb-92d6-41fd-9dad-08bfe203bc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:57 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Volume volume-d1d77204-1870-4cab-83fe-08f63beb667a (d1d77204-1870-4cab-83fe-08f63beb667a): created successfully Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef89deb-92d6-41fd-9dad-08bfe203bc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Flow 'volume_create_manager' (134d4ff4-f1ea-4e67-b923-710c49eb73d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:52:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-bab72cf8-1b70-48e1-a9a3-1bdf5dd4ee6a tempest-TaggedAttachmentsTest-891404498 None] Created volume successfully. Aug 26 18:52:58 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Aug 26 18:52:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b 1073741824" returned: 0 in 0.471s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:52:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:52:58 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b Aug 26 18:52:58 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:52:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b" returned: 0 in 0.263s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:52:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:52:58 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Aug 26 18:52:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:52:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be169a6c-f0c8-4f3a-8175-3865e7dcb4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6421acf-7829-4f52-8600-3fb41aa5d75b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb27ea5-1b92-4828-90f6-ab70cf729940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:52:58 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Volume volume-b6421acf-7829-4f52-8600-3fb41aa5d75b (b6421acf-7829-4f52-8600-3fb41aa5d75b): created successfully Aug 26 18:52:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb27ea5-1b92-4828-90f6-ab70cf729940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:52:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Flow 'volume_create_manager' (1900e11b-d570-411a-b033-42c241afa8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:52:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2105cec6-3820-4826-809a-e60f58f35e07 tempest-VolumesTestJSON-802809492 None] Created volume successfully. Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Flow 'volume_create_manager' (b97567ac-8a24-411d-b25d-fc5c4bed33d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4848c77c-e19f-4e32-9394-ec1e67e6b7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4848c77c-e19f-4e32-9394-ec1e67e6b7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-905908615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2711f48-b1eb-4317-b300-0290ef97eaea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31e79ba8c4a5458cac40bed2f0d93d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:53:01Z,use_quota=True,user_id='0af727cc0f634a819c0743c25e8ba09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e670274-3c51-41cb-9db0-1970d84a9111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e670274-3c51-41cb-9db0-1970d84a9111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e741ca4c-f32c-4fe3-abf7-3232f4be4bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e741ca4c-f32c-4fe3-abf7-3232f4be4bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2711f48-b1eb-4317-b300-0290ef97eaea', 'volume_name': 'volume-f2711f48-b1eb-4317-b300-0290ef97eaea', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89216c57-7481-411d-ba1f-465a36979f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89216c57-7481-411d-ba1f-465a36979f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d944002-2653-4276-b511-edcddbcb2db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:00 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Volume f2711f48-b1eb-4317-b300-0290ef97eaea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2711f48-b1eb-4317-b300-0290ef97eaea', 'volume_size': 1} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-905908615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2711f48-b1eb-4317-b300-0290ef97eaea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31e79ba8c4a5458cac40bed2f0d93d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:53:01Z,use_quota=True,user_id='0af727cc0f634a819c0743c25e8ba09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Creating volume f2711f48-b1eb-4317-b300-0290ef97eaea {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:53:00 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:53:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:00 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea 1073741824 Aug 26 18:53:00 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:01 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea 1073741824" returned: 0 in 0.657s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:01 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea Aug 26 18:53:01 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:01 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea" returned: 0 in 0.295s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:53:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d944002-2653-4276-b511-edcddbcb2db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2711f48-b1eb-4317-b300-0290ef97eaea', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52542416-5f0d-4082-b72c-e3bc0ea20246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:02 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Volume volume-f2711f48-b1eb-4317-b300-0290ef97eaea (f2711f48-b1eb-4317-b300-0290ef97eaea): created successfully Aug 26 18:53:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52542416-5f0d-4082-b72c-e3bc0ea20246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Flow 'volume_create_manager' (b97567ac-8a24-411d-b25d-fc5c4bed33d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:53:02 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-489bbd6e-df11-419b-8d2e-3ddca0765d31 tempest-VolumesTestJSON-802809492 None] Created volume successfully. Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Flow 'volume_create_manager' (1939f02d-9e53-4b67-a2de-8edd9125c80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bfa235-cc5e-4dc2-aa45-7c674abcb057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bfa235-cc5e-4dc2-aa45-7c674abcb057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-605665534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306e8f31-2671-45ca-9b38-8b0c7d7c9a4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31e79ba8c4a5458cac40bed2f0d93d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:53:04Z,use_quota=True,user_id='0af727cc0f634a819c0743c25e8ba09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe4c812-9c75-4229-b78e-96bb9251fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe4c812-9c75-4229-b78e-96bb9251fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2031bd00-3e62-490f-a340-9be530dafa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2031bd00-3e62-490f-a340-9be530dafa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306e8f31-2671-45ca-9b38-8b0c7d7c9a4b', 'volume_name': 'volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560e9842-3eba-4fad-81f7-0ca382ece060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560e9842-3eba-4fad-81f7-0ca382ece060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf23a34-da62-4f48-b142-7dbde739f69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:04 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Volume 306e8f31-2671-45ca-9b38-8b0c7d7c9a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b', 'volume_size': 1} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-605665534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306e8f31-2671-45ca-9b38-8b0c7d7c9a4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31e79ba8c4a5458cac40bed2f0d93d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:53:04Z,use_quota=True,user_id='0af727cc0f634a819c0743c25e8ba09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Creating volume 306e8f31-2671-45ca-9b38-8b0c7d7c9a4b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:53:04 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:04 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b 1073741824 Aug 26 18:53:04 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:04 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b 1073741824" returned: 0 in 0.613s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:04 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b Aug 26 18:53:04 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:05 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b" returned: 0 in 0.289s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:53:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf23a34-da62-4f48-b142-7dbde739f69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5b1a56-0c1a-4d1a-9aa8-ce41b7e09e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:05 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Volume volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b (306e8f31-2671-45ca-9b38-8b0c7d7c9a4b): created successfully Aug 26 18:53:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5b1a56-0c1a-4d1a-9aa8-ce41b7e09e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Flow 'volume_create_manager' (1939f02d-9e53-4b67-a2de-8edd9125c80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:53:05 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-65eae85d-0e6c-4d8a-9f4e-57455cb9ab82 tempest-VolumesTestJSON-802809492 None] Created volume successfully. Aug 26 18:53:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Acquiring lock "cinder-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Lock "cinder-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Acquiring lock "cinder-quobyte-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Lock "cinder-quobyte-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:07 devstack cinder-volume[93671]: INFO oslo.privsep.daemon [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprvr3geox/privsep.sock'] Aug 26 18:53:07 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprvr3geox/privsep.sock Aug 26 18:53:07 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:08 devstack cinder-volume[93671]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 26 18:53:08 devstack cinder-volume[93671]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 18:53:08 devstack cinder-volume[93671]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 26 18:53:08 devstack cinder-volume[93671]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 18:53:08 devstack cinder-volume[93671]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 26 18:53:08 devstack cinder-volume[93671]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 26 18:53:08 devstack cinder-volume[93671]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 18:53:08 devstack cinder-volume[93671]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 18:53:08 devstack cinder-volume[93671]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 26 18:53:08 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:08 devstack cinder-volume[93671]: INFO oslo.privsep.daemon [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Spawned new privsep daemon via rootwrap Aug 26 18:53:08 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Accepted privsep connection to /tmp/tmprvr3geox/privsep.sock {{(pid=93671) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 26 18:53:08 devstack cinder-volume[93671]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 26 18:53:08 devstack cinder-volume[93671]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 26 18:53:08 devstack cinder-volume[93671]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 26 18:53:08 devstack cinder-volume[93671]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94687 Aug 26 18:53:08 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d15725-9228-411a-b54c-c5dfc060348e]: (2,) {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:08 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aedc01e-a55d-4541-a94b-173c5631d381]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:08 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b Aug 26 18:53:08 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:09 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b" returned: 0 in 0.536s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:09 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b Aug 26 18:53:09 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:09 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b" returned: 0 in 0.385s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Lock "cinder-quobyte-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b" released by "delete_volume" :: held 2.199s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:09 devstack cinder-volume[93671]: WARNING cinder.quota [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:53:09 devstack cinder-volume[93671]: WARNING cinder.quota [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Created reservations ['1d37eafd-c413-4cc0-8f94-01066529c50b', '2d63c22a-a2a5-4bc2-b1a1-96e34c145424', '998c1582-5403-4a8c-b248-b527ad2e2d90', 'bc28a083-83bb-4ca6-8b9f-dfa2bcb3494e'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:09 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:53:09 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:10 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.397s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:10 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:53:10 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Deleted volume successfully. Aug 26 18:53:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0d5a75d2-1b2d-42dd-bcb8-6e138121a791 tempest-VolumesTestJSON-802809492 None] Lock "cinder-306e8f31-2671-45ca-9b38-8b0c7d7c9a4b-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Acquiring lock "cinder-f2711f48-b1eb-4317-b300-0290ef97eaea-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Lock "cinder-f2711f48-b1eb-4317-b300-0290ef97eaea-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Acquiring lock "cinder-quobyte-f2711f48-b1eb-4317-b300-0290ef97eaea" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Lock "cinder-quobyte-f2711f48-b1eb-4317-b300-0290ef97eaea" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:10 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09ae0f4-e220-47b9-8014-6ef8d76188f3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:11 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea Aug 26 18:53:11 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:11 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea" returned: 0 in 0.487s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:11 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea Aug 26 18:53:11 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:11 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f2711f48-b1eb-4317-b300-0290ef97eaea" returned: 0 in 0.343s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Lock "cinder-quobyte-f2711f48-b1eb-4317-b300-0290ef97eaea" released by "delete_volume" :: held 0.885s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:11 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Created reservations ['aa89b228-c226-4651-9428-ca7daa0daf68', '1c91699e-f2da-40c8-961f-d32ff72fb3da', 'dfb8b3bf-d56b-4e56-b87d-3463302edbde', '948b16c8-6def-48c6-ae33-c1244bd87761'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:53:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:12 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:53:12 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:12 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.280s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:12 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:53:12 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Deleted volume successfully. Aug 26 18:53:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f49c2be8-f197-4e7a-a7f7-6e487ee1487a tempest-VolumesTestJSON-802809492 None] Lock "cinder-f2711f48-b1eb-4317-b300-0290ef97eaea-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Acquiring lock "cinder-b6421acf-7829-4f52-8600-3fb41aa5d75b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Lock "cinder-b6421acf-7829-4f52-8600-3fb41aa5d75b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Acquiring lock "cinder-quobyte-b6421acf-7829-4f52-8600-3fb41aa5d75b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Lock "cinder-quobyte-b6421acf-7829-4f52-8600-3fb41aa5d75b" acquired by "delete_volume" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:13 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb92db5c-b2dc-4ae1-a1d8-47512926ef48]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:13 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b Aug 26 18:53:13 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:13 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b" returned: 0 in 0.411s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:13 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b Aug 26 18:53:13 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:14 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b6421acf-7829-4f52-8600-3fb41aa5d75b" returned: 0 in 0.268s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Lock "cinder-quobyte-b6421acf-7829-4f52-8600-3fb41aa5d75b" released by "delete_volume" :: held 0.746s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Created reservations ['229be36c-b341-4abd-8374-3c49c1f85a68', 'cb5b723e-56fa-486c-b5cb-3828bba6759d', 'bcfc5002-ea92-480c-a688-97e612f515e4', '1571eeb1-1b18-4c8d-aa5b-9eae66c7583c'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:14 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:53:14 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:14 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.685s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:14 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:53:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Deleted volume successfully. Aug 26 18:53:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-832faa43-ccf4-4576-95d3-808d56f92dfd tempest-VolumesTestJSON-802809492 None] Lock "cinder-b6421acf-7829-4f52-8600-3fb41aa5d75b-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Flow 'volume_create_manager' (1fa7cf0f-97d7-4a14-af23-6c3dab1da05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f30fb5-4c1c-43fb-9126-a0084e417361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f30fb5-4c1c-43fb-9126-a0084e417361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1465793769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ea5001-9e05-4f4b-9ac1-66b995066079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fe5e3e321b4facabb571d0754b9250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:53:16Z,use_quota=True,user_id='06aeff2582cf4cada89f003db2f1940e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553c1edc-d178-4e78-b9bc-46cd5f13463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553c1edc-d178-4e78-b9bc-46cd5f13463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0b5d5a-b632-49c2-a207-4705d08e27cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0b5d5a-b632-49c2-a207-4705d08e27cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43ea5001-9e05-4f4b-9ac1-66b995066079', 'volume_name': 'volume-43ea5001-9e05-4f4b-9ac1-66b995066079', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbc7239-d7d1-4d51-8066-1d1d67c2c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbc7239-d7d1-4d51-8066-1d1d67c2c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1950ed6d-d7d0-46bc-a600-412d525fb883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:16 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Volume 43ea5001-9e05-4f4b-9ac1-66b995066079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43ea5001-9e05-4f4b-9ac1-66b995066079', 'volume_size': 1} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1465793769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ea5001-9e05-4f4b-9ac1-66b995066079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05fe5e3e321b4facabb571d0754b9250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:53:16Z,use_quota=True,user_id='06aeff2582cf4cada89f003db2f1940e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Creating volume 43ea5001-9e05-4f4b-9ac1-66b995066079 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:53:16 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:16 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079 1073741824 Aug 26 18:53:16 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:16 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079 1073741824" returned: 0 in 0.548s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:16 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079 Aug 26 18:53:16 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:17 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079" returned: 0 in 0.470s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:53:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1950ed6d-d7d0-46bc-a600-412d525fb883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ea5001-9e05-4f4b-9ac1-66b995066079', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a7dce4-1a5c-4fa3-a1e2-6d8551bee09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:17 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Volume volume-43ea5001-9e05-4f4b-9ac1-66b995066079 (43ea5001-9e05-4f4b-9ac1-66b995066079): created successfully Aug 26 18:53:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a7dce4-1a5c-4fa3-a1e2-6d8551bee09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Flow 'volume_create_manager' (1fa7cf0f-97d7-4a14-af23-6c3dab1da05e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:53:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0aae4a22-b53c-46e8-b2d3-f988dc625a64 tempest-AttachVolumeShelveTestJSON-1630878805 None] Created volume successfully. Aug 26 18:53:27 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=23,cinder:UPDATE=45,cinder:INSERT=8,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:53:27 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=27,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=7 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:53:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f376120e-84cb-46fd-871f-a369614188b2 tempest-GroupsV314Test-2106926745 None] Group tempest-GroupsV314Test-Group-1664972677: creating Aug 26 18:53:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f376120e-84cb-46fd-871f-a369614188b2 tempest-GroupsV314Test-2106926745 None] Group tempest-GroupsV314Test-Group-1664972677: created successfully Aug 26 18:53:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f376120e-84cb-46fd-871f-a369614188b2 tempest-GroupsV314Test-2106926745 None] Create group completed successfully. Aug 26 18:53:30 devstack cinder-volume[93671]: WARNING py.warnings [req-230752f2-bfd2-479c-9e36-5e50638b294e req-336bb6e3-4d5b-4018-985f-e932a10b61d4 tempest-AttachVolumeShelveTestJSON-1630878805 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 26 18:53:30 devstack cinder-volume[93671]: .first() Aug 26 18:53:30 devstack cinder-volume[93671]: Aug 26 18:53:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-230752f2-bfd2-479c-9e36-5e50638b294e req-336bb6e3-4d5b-4018-985f-e932a10b61d4 tempest-AttachVolumeShelveTestJSON-1630878805 None] No connector for attachment 09925eaf-d9ad-45ce-ae7f-71e20b74b1f4; skipping storage backend terminate_connection call. {{(pid=93671) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 26 18:53:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-230752f2-bfd2-479c-9e36-5e50638b294e req-336bb6e3-4d5b-4018-985f-e932a10b61d4 tempest-AttachVolumeShelveTestJSON-1630878805 None] Deleting attachment 09925eaf-d9ad-45ce-ae7f-71e20b74b1f4. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Flow 'volume_create_manager' (60ddeb4e-df44-4455-8a6b-dcc01935a0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1e3d42-e2f8-4906-91a9-8531cefed912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1e3d42-e2f8-4906-91a9-8531cefed912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1454531906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=931c144e-f11a-4f5c-85ea-fda3b22194d9,host='devstack@QuobyteHD#QuobyteHD',id=0b272ed6-f981-449a-9116-9e94588a178b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3857b396114856a5a147388aa320df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:53:32Z,use_quota=True,user_id='975c498176874d2593bffe01e8fdfff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfd5c29a-041a-4c35-8a63-0d85fbe93afb),volume_type_id=cfd5c29a-041a-4c35-8a63-0d85fbe93afb)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50e86af-0cf9-47d5-a479-286044eb5402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50e86af-0cf9-47d5-a479-286044eb5402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cf4504-0e80-4761-a64e-ad1406d5e8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cf4504-0e80-4761-a64e-ad1406d5e8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b272ed6-f981-449a-9116-9e94588a178b', 'volume_name': 'volume-0b272ed6-f981-449a-9116-9e94588a178b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ab5d0e-d3c5-4dfe-b663-203dc3d9ca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ab5d0e-d3c5-4dfe-b663-203dc3d9ca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc53620-0157-4ae8-8f8d-a2327501a64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:32 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Volume 0b272ed6-f981-449a-9116-9e94588a178b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b272ed6-f981-449a-9116-9e94588a178b', 'volume_size': 1} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=931c144e-f11a-4f5c-85ea-fda3b22194d9,created_at=2026-08-26T16:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1454531906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=931c144e-f11a-4f5c-85ea-fda3b22194d9,host='devstack@QuobyteHD#QuobyteHD',id=0b272ed6-f981-449a-9116-9e94588a178b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d3857b396114856a5a147388aa320df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:53:32Z,use_quota=True,user_id='975c498176874d2593bffe01e8fdfff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfd5c29a-041a-4c35-8a63-0d85fbe93afb),volume_type_id=cfd5c29a-041a-4c35-8a63-0d85fbe93afb)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Creating volume 0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:53:32 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:32 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b 1073741824 Aug 26 18:53:32 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:32 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b 1073741824" returned: 0 in 0.499s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:33 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b Aug 26 18:53:33 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:33 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b" returned: 0 in 0.264s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:53:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc53620-0157-4ae8-8f8d-a2327501a64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b272ed6-f981-449a-9116-9e94588a178b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af566212-584d-443f-bf02-c1436ac31ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:53:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Volume volume-0b272ed6-f981-449a-9116-9e94588a178b (0b272ed6-f981-449a-9116-9e94588a178b): created successfully Aug 26 18:53:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af566212-584d-443f-bf02-c1436ac31ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:53:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Flow 'volume_create_manager' (60ddeb4e-df44-4455-8a6b-dcc01935a0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:53:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-df1585f2-e352-4b60-a919-17966b19b7c7 tempest-GroupsV314Test-2106926745 None] Created volume successfully. Aug 26 18:53:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:34 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Cloning volume 0b272ed6-f981-449a-9116-9e94588a178b to volume 8c1a2120-1ebc-4130-8e68-e7bd45e6de19 Aug 26 18:53:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Creating offline snapshot 11d805c2-62cf-4c35-9c24-b4493a47f39b of volume 0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:53:34 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[031d26b0-ae49-4bfa-9d91-76892381e35b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:35 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b Aug 26 18:53:35 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:35 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b" returned: 0 in 0.492s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:35 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b 1G Aug 26 18:53:35 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:35 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b 1G" returned: 0 in 0.540s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b272ed6-f981-449a-9116-9e94588a178b -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:35 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b272ed6-f981-449a-9116-9e94588a178b -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b Aug 26 18:53:35 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:36 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b272ed6-f981-449a-9116-9e94588a178b -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b" returned: 0 in 0.300s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:36 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:53:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:36 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b Aug 26 18:53:36 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:36 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b" returned: 0 in 0.334s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:36 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.info Aug 26 18:53:36 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:37 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.info" returned: 0 in 0.479s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:37 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:37 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.info Aug 26 18:53:37 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:37 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.info" returned: 0 in 0.484s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Acquiring lock "cinder-quobyte-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Lock "cinder-quobyte-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] snapshot: 11d805c2-62cf-4c35-9c24-b4493a47f39b, volume: 8c1a2120-1ebc-4130-8e68-e7bd45e6de19, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c3f9c-43f9-4ee8-a242-bf7d6e298b62]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:37 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b Aug 26 18:53:37 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:38 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b" returned: 0 in 0.475s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b272ed6-f981-449a-9116-9e94588a178b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:53:38 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45cc667-3b7a-4710-9dc2-7afc8e84c1bd]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:38 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b Aug 26 18:53:38 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:38 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b" returned: 0 in 0.429s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 18:53:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 18:53:38 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 18:53:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:38 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 Aug 26 18:53:38 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:45 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" returned: 0 in 6.622s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 18:53:45 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Converted 1024.00 MB image at 154.61 MB/s Aug 26 18:53:45 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:45 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 Aug 26 18:53:45 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:45 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" returned: 0 in 0.421s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Lock "cinder-quobyte-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" released by "_copy_volume_from_snapshot" :: held 8.096s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Acquiring lock "cinder-quobyte-11d805c2-62cf-4c35-9c24-b4493a47f39b" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Lock "cinder-quobyte-11d805c2-62cf-4c35-9c24-b4493a47f39b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Deleting offline snapshot 11d805c2-62cf-4c35-9c24-b4493a47f39b of volume 0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] snapshot_file for this snap is: volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af68dfa-18ee-4afc-bd8b-1736ae2c1a2d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:46 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b Aug 26 18:53:46 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:46 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b" returned: 0 in 0.702s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b272ed6-f981-449a-9116-9e94588a178b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:53:46 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:53:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[103b640d-3a3d-4e7e-8010-2d16517a04dd]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:46 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b Aug 26 18:53:46 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:47 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b" returned: 0 in 1.340s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:47 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b Aug 26 18:53:47 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b" returned: 0 in 0.819s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:48 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:48 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b Aug 26 18:53:48 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:49 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b.11d805c2-62cf-4c35-9c24-b4493a47f39b" returned: 0 in 0.625s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Lock "cinder-quobyte-11d805c2-62cf-4c35-9c24-b4493a47f39b" released by "_delete_snapshot" :: held 3.695s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.851s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:49 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-99a094a3-4725-40bc-a26d-a12f9e6b1908 tempest-GroupsV314Test-2106926745 None] Create group from source-group-931c144e-f11a-4f5c-85ea-fda3b22194d9 completed successfully. Aug 26 18:53:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Acquiring lock "cinder-quobyte-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Lock "cinder-quobyte-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:51 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd9c453-e2d7-4728-b957-5b7fde44eca7]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:51 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 Aug 26 18:53:51 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:51 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" returned: 0 in 0.500s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:51 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19 Aug 26 18:53:51 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-40f8fa65-e127-418e-ba5a-a78d931dd482 req-15a60da1-4cd3-4ad4-b7cd-d34c8638a251 tempest-TaggedAttachmentsTest-891404498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-40f8fa65-e127-418e-ba5a-a78d931dd482 req-15a60da1-4cd3-4ad4-b7cd-d34c8638a251 tempest-TaggedAttachmentsTest-891404498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:52 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" returned: 0 in 0.303s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-40f8fa65-e127-418e-ba5a-a78d931dd482 req-15a60da1-4cd3-4ad4-b7cd-d34c8638a251 tempest-TaggedAttachmentsTest-891404498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Lock "cinder-quobyte-8c1a2120-1ebc-4130-8e68-e7bd45e6de19" released by "delete_volume" :: held 0.910s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-40f8fa65-e127-418e-ba5a-a78d931dd482 req-15a60da1-4cd3-4ad4-b7cd-d34c8638a251 tempest-TaggedAttachmentsTest-891404498 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-d1d77204-1870-4cab-83fe-08f63beb667a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1010bf0b-16c6-48fa-b3ef-4608558c8c67', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Created reservations ['4c71133a-4200-4baf-8f7e-547389142d50'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:53:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-40f8fa65-e127-418e-ba5a-a78d931dd482 req-15a60da1-4cd3-4ad4-b7cd-d34c8638a251 tempest-TaggedAttachmentsTest-891404498 None] attachment_update completed successfully. Aug 26 18:53:52 devstack cinder-volume[93671]: WARNING cinder.quota [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-411731476 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-411731476, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:53:52 devstack cinder-volume[93671]: WARNING cinder.quota [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-411731476 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-411731476, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Created reservations ['193477a6-9fb1-46c9-ae86-272d455ffff2', '86b4b30c-50d0-4800-8429-90d853e31893', 'e43fc613-126f-4ccd-b228-37a1d49e459b', 'b83dbe99-893d-4412-97dd-4e94126638f1'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:52 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:53:52 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:53 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.339s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:53 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:53:53 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d2bd4fc9-bf8e-4495-84a9-114d57235445 tempest-GroupsV314Test-2106926745 None] Delete group completed successfully. Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:54 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:53:54 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Acquiring lock "cinder-quobyte-0b272ed6-f981-449a-9116-9e94588a178b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Lock "cinder-quobyte-0b272ed6-f981-449a-9116-9e94588a178b" acquired by "delete_volume" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fefaa9-7c89-4adb-8aaf-832237e71e4d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:53:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:55 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.593s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:53:55 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:53:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 8 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:53:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:53:55 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b Aug 26 18:53:55 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:55 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b" returned: 0 in 0.823s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:55 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b Aug 26 18:53:55 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:56 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0b272ed6-f981-449a-9116-9e94588a178b" returned: 0 in 0.457s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Lock "cinder-quobyte-0b272ed6-f981-449a-9116-9e94588a178b" released by "delete_volume" :: held 1.412s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Created reservations ['21fd88d7-5fe5-4f72-b25e-cd5f74585d6e'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Created reservations ['529e80e9-25a7-461b-ad25-16754883e2cf', '87528b16-50d6-41bc-b3fa-b91832c7e949', '5885157e-efde-4026-ab3a-5d43eba46354', 'a985cb2f-263b-4a5c-8065-ce9cec16d854'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:53:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:53:56 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:53:56 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:53:57 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Aug 26 18:53:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.467s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:53:57 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:53:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-5ddf0fc4-33f9-4a4b-8122-9d5d03243402 tempest-GroupsV314Test-2106926745 None] Delete group completed successfully. Aug 26 18:53:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-14622fee-b17a-4f22-a8bc-859f8d5e1258 req-3b59a1ab-9fc6-4af2-8307-5a160cf14833 tempest-TaggedAttachmentsTest-891404498 None] Terminate volume connection completed successfully. Aug 26 18:53:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-14622fee-b17a-4f22-a8bc-859f8d5e1258 req-3b59a1ab-9fc6-4af2-8307-5a160cf14833 tempest-TaggedAttachmentsTest-891404498 None] Deleting attachment 1010bf0b-16c6-48fa-b3ef-4608558c8c67. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:54:08 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=24,cinder:SELECT=25,cinder:INSERT=6 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:54:08 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=35,cinder:UPDATE=34,cinder:DELETE=1,cinder:INSERT=5 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:54:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Acquiring lock "cinder-d1d77204-1870-4cab-83fe-08f63beb667a-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Lock "cinder-d1d77204-1870-4cab-83fe-08f63beb667a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Acquiring lock "cinder-quobyte-d1d77204-1870-4cab-83fe-08f63beb667a" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Lock "cinder-quobyte-d1d77204-1870-4cab-83fe-08f63beb667a" acquired by "delete_volume" :: waited 0.042s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[359d0009-3de9-4ae0-8413-e8d1c18e93d3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:12 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a Aug 26 18:54:12 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:12 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a" returned: 0 in 0.617s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:12 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a Aug 26 18:54:12 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:12 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d1d77204-1870-4cab-83fe-08f63beb667a" returned: 0 in 0.301s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Lock "cinder-quobyte-d1d77204-1870-4cab-83fe-08f63beb667a" released by "delete_volume" :: held 1.029s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Created reservations ['86b8c1c4-2299-4af1-a6c9-cac963519f90', '5ee9bd79-cdc7-4d8f-8e9f-f78cf97eb36a', 'ea8da0df-87d0-40b3-8a9d-1a0c80be2489', 'a36d9215-91e6-4bc3-8cb3-0e6ba72497d2'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:13 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:54:13 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:13 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.494s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:54:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Deleted volume successfully. Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc819ad9-ba76-430c-865a-eff9a2168fdf tempest-TaggedAttachmentsTest-891404498 None] Lock "cinder-d1d77204-1870-4cab-83fe-08f63beb667a-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:13 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Flow 'volume_create_manager' (d862d09b-b4e5-4535-a0cc-a9b6b3525a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2250bc44-c4be-4d82-9f12-5bb9b9336a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2250bc44-c4be-4d82-9f12-5bb9b9336a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1301338282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ae74a1-539a-40be-ad2f-2c8cd4043cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23818d226dc74387b1bdb62e70ed1ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:54:14Z,use_quota=True,user_id='8deb18bbd9fd4205be2096ae521b0c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdbcc0b-620e-4e8a-9acc-629820d280fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdbcc0b-620e-4e8a-9acc-629820d280fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7724ec-cc08-4ecb-8fbe-fb52b7dac343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7724ec-cc08-4ecb-8fbe-fb52b7dac343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ae74a1-539a-40be-ad2f-2c8cd4043cf8', 'volume_name': 'volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8881ac-4698-4448-aa82-079e4208689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8881ac-4698-4448-aa82-079e4208689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918a74f3-e214-4409-866e-6e705f98cfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:14 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Volume 56ae74a1-539a-40be-ad2f-2c8cd4043cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8', 'volume_size': 1} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1301338282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ae74a1-539a-40be-ad2f-2c8cd4043cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23818d226dc74387b1bdb62e70ed1ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:54:14Z,use_quota=True,user_id='8deb18bbd9fd4205be2096ae521b0c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Creating volume 56ae74a1-539a-40be-ad2f-2c8cd4043cf8 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:54:14 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:54:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:14 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 1073741824 Aug 26 18:54:14 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:15 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 1073741824" returned: 0 in 1.241s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:15 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 Aug 26 18:54:15 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:15 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8" returned: 0 in 0.416s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:54:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918a74f3-e214-4409-866e-6e705f98cfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2b6a43-1fe4-4b75-b06a-65fb43649261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:15 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Volume volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 (56ae74a1-539a-40be-ad2f-2c8cd4043cf8): created successfully Aug 26 18:54:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2b6a43-1fe4-4b75-b06a-65fb43649261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Flow 'volume_create_manager' (d862d09b-b4e5-4535-a0cc-a9b6b3525a11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:54:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ca5cf535-7d5e-4424-9657-d5f8cae59027 tempest-VolumesAdminNegativeTest-1353743267 None] Created volume successfully. Aug 26 18:54:16 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:54:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Flow 'volume_create_manager' (1b86d639-6844-4662-8942-5c181eb31182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:54:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7c7458-d71d-4cda-936d-165131368438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7c7458-d71d-4cda-936d-165131368438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-131298576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a9812-948a-442e-9f5a-471480604cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64f63ab454b4f859a454a9984e316b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:54:17Z,use_quota=True,user_id='1f2a791ff53645a99440395b0cc77ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0623e6-a5ba-4396-9c03-4a5d774dc9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0623e6-a5ba-4396-9c03-4a5d774dc9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00aa5328-2350-40f5-aee8-0a3ef5cb0ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00aa5328-2350-40f5-aee8-0a3ef5cb0ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0a9812-948a-442e-9f5a-471480604cc6', 'volume_name': 'volume-bd0a9812-948a-442e-9f5a-471480604cc6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60308a6-fdc2-47a6-bba8-cf864e4ef146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60308a6-fdc2-47a6-bba8-cf864e4ef146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785c8264-a07d-4155-ba78-de9466993419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:17 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Volume bd0a9812-948a-442e-9f5a-471480604cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0a9812-948a-442e-9f5a-471480604cc6', 'volume_size': 1} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-131298576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a9812-948a-442e-9f5a-471480604cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64f63ab454b4f859a454a9984e316b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:54:17Z,use_quota=True,user_id='1f2a791ff53645a99440395b0cc77ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Creating volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:54:17 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:17 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 1073741824 Aug 26 18:54:17 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Acquiring lock "cinder-56ae74a1-539a-40be-ad2f-2c8cd4043cf8-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Lock "cinder-56ae74a1-539a-40be-ad2f-2c8cd4043cf8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Acquiring lock "cinder-quobyte-56ae74a1-539a-40be-ad2f-2c8cd4043cf8" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Lock "cinder-quobyte-56ae74a1-539a-40be-ad2f-2c8cd4043cf8" acquired by "delete_volume" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf2178b-4823-4263-bf2f-c409cea01a2e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:17 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 Aug 26 18:54:17 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:18 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 1073741824" returned: 0 in 0.956s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:18 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 Aug 26 18:54:18 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:18 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8" returned: 0 in 0.628s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:18 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8 Aug 26 18:54:18 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:18 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-56ae74a1-539a-40be-ad2f-2c8cd4043cf8" returned: 0 in 0.336s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Lock "cinder-quobyte-56ae74a1-539a-40be-ad2f-2c8cd4043cf8" released by "delete_volume" :: held 1.043s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:18 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6" returned: 0 in 0.543s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785c8264-a07d-4155-ba78-de9466993419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0a9812-948a-442e-9f5a-471480604cc6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9574a67f-9462-4c3c-999c-28990e4e6c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:54:18 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Volume volume-bd0a9812-948a-442e-9f5a-471480604cc6 (bd0a9812-948a-442e-9f5a-471480604cc6): created successfully Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9574a67f-9462-4c3c-999c-28990e4e6c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Flow 'volume_create_manager' (1b86d639-6844-4662-8942-5c181eb31182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:54:18 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9894ebaa-1217-4f0a-9c0e-ed15a8a229ab tempest-SnapshotsActionsTest-955305258 None] Created volume successfully. Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Created reservations ['1e5d44b9-5df6-4d18-8b21-122f17f374f1', '8b895604-5356-4b4c-a710-aee55d4e75b9', '82b76fb8-1f45-44b2-9783-da909f7be917', 'd1e1cb77-0dc2-4b9e-9e97-0d5ca4f342ec'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:18 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:54:18 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:19 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.399s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:19 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:54:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Deleted volume successfully. Aug 26 18:54:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-77bf3065-5e49-40df-9113-8ae5ee45676e tempest-VolumesAdminNegativeTest-1353743267 None] Lock "cinder-56ae74a1-539a-40be-ad2f-2c8cd4043cf8-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Creating offline snapshot 769d5edb-22a4-455d-a241-7ad6fd359433 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:54:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7976d1d-4b1c-45da-b4ed-a2a278cd8d15]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:19 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 Aug 26 18:54:19 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Acquiring lock "cinder-43ea5001-9e05-4f4b-9ac1-66b995066079-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "cinder-43ea5001-9e05-4f4b-9ac1-66b995066079-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Acquiring lock "cinder-quobyte-43ea5001-9e05-4f4b-9ac1-66b995066079" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "cinder-quobyte-43ea5001-9e05-4f4b-9ac1-66b995066079" acquired by "delete_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4434113-97e4-469a-996b-89f9aef3ab9f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:20 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6" returned: 0 in 0.571s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:20 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 1G Aug 26 18:54:20 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:20 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079 Aug 26 18:54:20 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:20 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079" returned: 0 in 0.661s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:20 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079 Aug 26 18:54:20 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:21 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 1G" returned: 0 in 0.779s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:21 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:21 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:21 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-43ea5001-9e05-4f4b-9ac1-66b995066079" returned: 0 in 0.381s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "cinder-quobyte-43ea5001-9e05-4f4b-9ac1-66b995066079" released by "delete_volume" :: held 1.106s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Created reservations ['214dd16b-8817-477a-8196-44008d005ff9', 'dfe7367b-cabf-46ce-95cc-09af40cbebc9', 'a4efe431-aded-43da-895c-cda57b92a8a4', 'a5255179-89f5-43cb-98b4-9901fac213c1'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:21 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.418s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:21 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 is being set with open permissions: ugo+rw Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:21 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:54:21 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:21 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:21 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:21 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.324s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:21 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.info Aug 26 18:54:21 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:21 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.489s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:54:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Deleted volume successfully. Aug 26 18:54:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dbfda05f-19e8-46c3-b25a-f86d02cf5edc tempest-AttachVolumeShelveTestJSON-1630878805 None] Lock "cinder-43ea5001-9e05-4f4b-9ac1-66b995066079-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:22 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.info" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:22 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.info is being set with open permissions: ugo+rw Aug 26 18:54:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:22 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.info Aug 26 18:54:22 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:22 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.info" returned: 0 in 0.388s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.951s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0fb65627-fd5f-4de1-b7db-1a8f2bcd999f tempest-SnapshotsActionsTest-955305258 None] Create snapshot completed successfully Aug 26 18:54:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Creating offline snapshot a4044622-cc91-4589-a404-c88b9f0e8811 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:54:23 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab06e9e-54bb-4c67-8655-1ebfc3648d07]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:23 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:23 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:23 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.409s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:23 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 1G Aug 26 18:54:23 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:24 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 1G" returned: 0 in 0.551s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:24 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 Aug 26 18:54:24 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:24 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:24 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 is being set with open permissions: ugo+rw Aug 26 18:54:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:24 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 Aug 26 18:54:24 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:25 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811" returned: 0 in 0.292s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.705s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:25 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e28a14a8-6819-4536-8ba8-b815f02a0a36 tempest-SnapshotsActionsTest-955305258 None] Create snapshot completed successfully Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-a4044622-cc91-4589-a404-c88b9f0e8811-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-a4044622-cc91-4589-a404-c88b9f0e8811-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-quobyte-a4044622-cc91-4589-a404-c88b9f0e8811" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-a4044622-cc91-4589-a404-c88b9f0e8811" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Deleting offline snapshot a4044622-cc91-4589-a404-c88b9f0e8811 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] snapshot_file for this snap is: volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5493e84-a1f8-4511-b3ab-e919c0575358]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:25 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 Aug 26 18:54:25 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:26 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811" returned: 0 in 0.390s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d356c80e-358c-4e2e-b98f-a591b82cc0e3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:26 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:26 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:26 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.533s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:26 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 Aug 26 18:54:26 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:27 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811" returned: 0 in 0.463s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:27 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811 Aug 26 18:54:27 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:27 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.a4044622-cc91-4589-a404-c88b9f0e8811" returned: 0 in 0.254s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-a4044622-cc91-4589-a404-c88b9f0e8811" released by "_delete_snapshot" :: held 1.751s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" released by "delete_snapshot" :: held 1.774s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:27 devstack cinder-volume[93671]: WARNING cinder.quota [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:54:27 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Created reservations ['c4dd5320-7e4e-4d59-8b8f-aadfbc42f718', '0f3eb3f3-1a1f-42ec-8555-7414ce573571', '418ff8fb-ddef-46a4-bf14-5b56cce161a6', '9c4376b0-dfee-40c6-8253-22b7b241a21a'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:54:27 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Delete snapshot completed successfully. Aug 26 18:54:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-18753ca2-6332-4c38-96d4-bf2a96e0d6af tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-a4044622-cc91-4589-a404-c88b9f0e8811-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Creating offline snapshot 40f0e715-664e-4be8-be76-37af7a6e0791 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:54:28 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e701e7c2-c80d-47a9-bfeb-7a6c6cc7783d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:28 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:28 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:28 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.385s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:28 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 1G Aug 26 18:54:28 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:29 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 1G" returned: 0 in 0.601s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:29 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 Aug 26 18:54:29 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:29 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791" returned: 0 in 0.346s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:29 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 is being set with open permissions: ugo+rw Aug 26 18:54:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:29 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 Aug 26 18:54:29 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:29 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791" returned: 0 in 0.350s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9fddac49-0c84-4500-8ff1-86a853b7a1fb tempest-SnapshotsActionsTest-955305258 None] Create snapshot completed successfully Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-40f0e715-664e-4be8-be76-37af7a6e0791-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-40f0e715-664e-4be8-be76-37af7a6e0791-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-quobyte-40f0e715-664e-4be8-be76-37af7a6e0791" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-40f0e715-664e-4be8-be76-37af7a6e0791" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Deleting offline snapshot 40f0e715-664e-4be8-be76-37af7a6e0791 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] snapshot_file for this snap is: volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebf1a93-c6f1-499a-897f-491bbd939802]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:30 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 Aug 26 18:54:30 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:31 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791" returned: 0 in 0.499s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:31 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1bd3a6-513f-4332-ad31-a7f48cd0321d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:31 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:31 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:31 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.424s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:31 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 Aug 26 18:54:31 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:32 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791" returned: 0 in 0.577s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:32 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791 Aug 26 18:54:32 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:32 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.40f0e715-664e-4be8-be76-37af7a6e0791" returned: 0 in 0.310s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-40f0e715-664e-4be8-be76-37af7a6e0791" released by "_delete_snapshot" :: held 1.956s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" released by "delete_snapshot" :: held 1.996s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:32 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Created reservations ['b3e3c5b7-dac8-4bd3-a689-350367b43709', '1eb336b0-1967-4192-8f22-113cd77ff24d', '1abd2903-1362-41e0-9ed7-114bdb1ee39e', 'fbd983ec-6eab-4b8d-8dbb-04f190712117'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:54:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Delete snapshot completed successfully. Aug 26 18:54:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-506b85e7-b4af-415d-98c8-5dd54f07a6be tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-40f0e715-664e-4be8-be76-37af7a6e0791-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Creating offline snapshot 3e032ba8-cc0e-493b-bd16-b27b67127f99 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:54:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e27264-7600-4e0c-b0dd-beb4486d93a7]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:33 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:33 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:33 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.493s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:33 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 1G Aug 26 18:54:33 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:34 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 1G" returned: 0 in 0.479s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:34 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 Aug 26 18:54:34 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:34 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99" returned: 0 in 0.383s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:34 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 is being set with open permissions: ugo+rw Aug 26 18:54:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:34 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 Aug 26 18:54:34 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:34 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.776s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e9f4e5a5-4a4d-44ed-bbcd-cca394fd9c09 tempest-SnapshotsActionsTest-955305258 None] Create snapshot completed successfully Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-3e032ba8-cc0e-493b-bd16-b27b67127f99-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-3e032ba8-cc0e-493b-bd16-b27b67127f99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-quobyte-3e032ba8-cc0e-493b-bd16-b27b67127f99" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-3e032ba8-cc0e-493b-bd16-b27b67127f99" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Deleting offline snapshot 3e032ba8-cc0e-493b-bd16-b27b67127f99 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] snapshot_file for this snap is: volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc3a791-7733-486a-936f-c60feb046cd0]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:35 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 Aug 26 18:54:35 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:35 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99" returned: 0 in 0.459s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5c0dbb-44f6-4f92-8f02-1f355335e15e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:36 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:36 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:36 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.410s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:36 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 Aug 26 18:54:36 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:36 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99" returned: 0 in 0.492s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:36 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99 Aug 26 18:54:36 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:37 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.3e032ba8-cc0e-493b-bd16-b27b67127f99" returned: 0 in 0.268s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-3e032ba8-cc0e-493b-bd16-b27b67127f99" released by "_delete_snapshot" :: held 1.752s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" released by "delete_snapshot" :: held 1.781s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:37 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Created reservations ['861eff8b-e855-4690-97f7-eeb4736e6329', '9c55de7f-bede-48a0-a41e-e2200995a0f6', 'ebaf1d46-1651-45cf-a6c7-90da61e14dec', '19f82d7d-0ba6-42ed-a654-d85741fc7f27'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:54:37 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Delete snapshot completed successfully. Aug 26 18:54:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e13c9480-e502-4620-b2ad-290e70fc83a3 tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-3e032ba8-cc0e-493b-bd16-b27b67127f99-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Creating offline snapshot 4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:54:37 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9a0f0c-d3a7-4be0-be38-d29dab01a6d5]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:38 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:38 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:38 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.400s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:38 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 1G Aug 26 18:54:38 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:38 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 1G" returned: 0 in 0.500s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:38 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 Aug 26 18:54:38 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:39 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9" returned: 0 in 0.413s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:39 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 is being set with open permissions: ugo+rw Aug 26 18:54:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:39 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 Aug 26 18:54:39 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:39 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9" returned: 0 in 0.282s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.722s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:39 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c9bd3af4-f840-4cd0-afeb-847fb61030f6 tempest-SnapshotsActionsTest-955305258 None] Create snapshot completed successfully Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Acquiring lock "cinder-quobyte-4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Deleting offline snapshot 4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] snapshot_file for this snap is: volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[19717652-4436-44d7-8923-d5a7a91ac995]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:40 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 Aug 26 18:54:40 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:40 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9" returned: 0 in 0.401s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c620e4-d791-4146-aa09-1901b1422349]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:40 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:40 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:41 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.402s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:41 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 Aug 26 18:54:41 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:41 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9" returned: 0 in 0.402s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:41 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9 Aug 26 18:54:41 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:41 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9" returned: 0 in 0.267s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9" released by "_delete_snapshot" :: held 1.591s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" released by "delete_snapshot" :: held 1.622s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Created reservations ['47d186ea-91bf-453b-ba87-7189580c5052', 'ad22e66f-4855-48e5-998a-c4a49119b61f', '7e1aa8e7-d8c3-4bb5-be14-621ff39e9bf8', 'cd8a6a6e-61d0-4dbb-82be-3949801ad6d9'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:54:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Delete snapshot completed successfully. Aug 26 18:54:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-14f58d18-5c9e-4083-9098-7fb20c2f570f tempest-SnapshotsActionsTest-1643241918 None] Lock "cinder-4d3acfd6-10a2-4c80-a7de-3c2b8ab537a9-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "cinder-769d5edb-22a4-455d-a241-7ad6fd359433-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-769d5edb-22a4-455d-a241-7ad6fd359433-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "cinder-quobyte-769d5edb-22a4-455d-a241-7ad6fd359433" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-quobyte-769d5edb-22a4-455d-a241-7ad6fd359433" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Deleting offline snapshot 769d5edb-22a4-455d-a241-7ad6fd359433 of volume bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:54:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] snapshot_file for this snap is: volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:54:43 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf92ff5-7315-4d92-9484-c426193809c5]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:43 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:43 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:43 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.423s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd0a9812-948a-442e-9f5a-471480604cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:54:43 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdc7dbe-8878-4811-8eb4-ac5e6893a7ff]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:43 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 Aug 26 18:54:43 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:43 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6" returned: 0 in 0.450s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:43 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:43 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:44 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.463s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:44 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433 Aug 26 18:54:44 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:44 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6.769d5edb-22a4-455d-a241-7ad6fd359433" returned: 0 in 0.480s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-quobyte-769d5edb-22a4-455d-a241-7ad6fd359433" released by "_delete_snapshot" :: held 1.967s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" released by "delete_snapshot" :: held 1.998s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:45 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Created reservations ['912adfe4-6a72-4c8b-9d82-faa34b05236b', '19a8eacf-6e8c-4331-b7b6-08bf03c7c36f', '433eb801-0592-47e6-9ccb-2c373b5a296e', '347cc3b6-d67d-4f22-b5c2-2258cae00f14'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:54:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Delete snapshot completed successfully. Aug 26 18:54:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-437497ce-6f55-41cd-bb0d-826f515ebc40 tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-769d5edb-22a4-455d-a241-7ad6fd359433-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "cinder-bd0a9812-948a-442e-9f5a-471480604cc6-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-bd0a9812-948a-442e-9f5a-471480604cc6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:54:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:54:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33c99cc-90c4-4670-a2f4-9988f4ad0133]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:54:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:46 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 Aug 26 18:54:46 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:46 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6" returned: 0 in 0.406s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:46 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6 Aug 26 18:54:46 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:47 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bd0a9812-948a-442e-9f5a-471480604cc6" returned: 0 in 0.319s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-quobyte-bd0a9812-948a-442e-9f5a-471480604cc6" released by "delete_volume" :: held 0.785s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Created reservations ['ae72e245-79ef-4028-9e06-06835e63b056', 'a2024bb1-4269-4864-836e-23b7ad83e28f', 'fb92856b-d077-41ce-8f4b-bd7cc23809ee', '9708a1e8-613a-4a8b-9ed5-f68cb4936535'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:47 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:54:47 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:47 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.279s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:54:47 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Deleted volume successfully. Aug 26 18:54:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-de4dc429-8d4e-44dc-a4d2-39aadd460aaa tempest-SnapshotsActionsTest-955305258 None] Lock "cinder-bd0a9812-948a-442e-9f5a-471480604cc6-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:54:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:54:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:54:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:54:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:54:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:54:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:54:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:54:54 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:54:54 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:54:54 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Aug 26 18:54:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.528s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:54:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:54:55 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:54:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 8 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:54:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:54:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=73,cinder:SELECT=58,cinder:INSERT=15,cinder:DELETE=5 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:54:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=64,cinder:INSERT=24,cinder:UPDATE=69,cinder:DELETE=6 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Flow 'volume_create_manager' (c2d9a37f-62c7-4ef5-a0fc-8eac5a650408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746e7bf4-f659-4a0a-97cc-a238b622619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746e7bf4-f659-4a0a-97cc-a238b622619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-661018391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51081106-3e5d-4cce-94bc-f2fd66d5774c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812ebac4076d41a7b4d42ddab241879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:15Z,use_quota=True,user_id='599b1a5700134b89acb0b29634436ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13c4937-8ad6-46a0-a3cd-2b1ff7dbf518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13c4937-8ad6-46a0-a3cd-2b1ff7dbf518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d330df-a7bb-4449-9106-cae2f75c4f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d330df-a7bb-4449-9106-cae2f75c4f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51081106-3e5d-4cce-94bc-f2fd66d5774c', 'volume_name': 'volume-51081106-3e5d-4cce-94bc-f2fd66d5774c', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1061ddb5-098b-4c9e-9893-80014e1c1c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1061ddb5-098b-4c9e-9893-80014e1c1c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be3d149-33c9-449e-974a-b6837be6c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:15 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Volume 51081106-3e5d-4cce-94bc-f2fd66d5774c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51081106-3e5d-4cce-94bc-f2fd66d5774c', 'volume_size': 1} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-661018391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51081106-3e5d-4cce-94bc-f2fd66d5774c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812ebac4076d41a7b4d42ddab241879a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:15Z,use_quota=True,user_id='599b1a5700134b89acb0b29634436ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Creating volume 51081106-3e5d-4cce-94bc-f2fd66d5774c {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:55:15 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:55:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:15 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c 1073741824 Aug 26 18:55:15 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:16 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c 1073741824" returned: 0 in 1.213s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:16 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c Aug 26 18:55:16 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:16 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c" returned: 0 in 0.449s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:55:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be3d149-33c9-449e-974a-b6837be6c1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51081106-3e5d-4cce-94bc-f2fd66d5774c', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82abc67-e396-461c-91a3-9bb953034979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:17 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Volume volume-51081106-3e5d-4cce-94bc-f2fd66d5774c (51081106-3e5d-4cce-94bc-f2fd66d5774c): created successfully Aug 26 18:55:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82abc67-e396-461c-91a3-9bb953034979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Flow 'volume_create_manager' (c2d9a37f-62c7-4ef5-a0fc-8eac5a650408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d77b441a-e2e5-4166-ab96-5783c17dd073 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Created volume successfully. Aug 26 18:55:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Acquiring lock "cinder-51081106-3e5d-4cce-94bc-f2fd66d5774c-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:55:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "cinder-51081106-3e5d-4cce-94bc-f2fd66d5774c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:55:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Acquiring lock "cinder-quobyte-51081106-3e5d-4cce-94bc-f2fd66d5774c" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:55:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "cinder-quobyte-51081106-3e5d-4cce-94bc-f2fd66d5774c" acquired by "delete_volume" :: waited 0.045s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:55:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acdd537-4953-453b-beba-b16b749bb788]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:55:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:19 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c Aug 26 18:55:19 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:20 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c" returned: 0 in 0.416s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:20 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c Aug 26 18:55:20 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:20 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-51081106-3e5d-4cce-94bc-f2fd66d5774c" returned: 0 in 0.302s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "cinder-quobyte-51081106-3e5d-4cce-94bc-f2fd66d5774c" released by "delete_volume" :: held 0.788s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Created reservations ['33d3ed81-ff55-449e-acbd-d7a3c0f2e573', '5fdfdfd4-d75f-4174-8e21-208079e2d81e', '8d037b87-a80d-40ba-8362-58652b43eecc', 'a2f7f47e-c356-4215-9049-40424699994e'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:20 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:55:20 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:20 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.373s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:20 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:55:20 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Deleted volume successfully. Aug 26 18:55:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-613af28c-b173-4f85-90f8-e665b236d444 tempest-VolumeQuotasNegativeTestJSON-547149954 None] Lock "cinder-51081106-3e5d-4cce-94bc-f2fd66d5774c-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Flow 'volume_create_manager' (2bc6fb31-ad85-46c0-b8ec-d9e7671c6545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394c3de4-229d-4fcc-8c23-748fcd0f9c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394c3de4-229d-4fcc-8c23-748fcd0f9c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1396787719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b33dc96-edef-4e81-a476-48da550d6b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77cb9cb57ef4816ad408137fb01fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:24Z,use_quota=True,user_id='dc43953313ec40b6afd61ce22dd8b5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48d35e2-1bb3-4ef1-bcda-bae8caf350e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48d35e2-1bb3-4ef1-bcda-bae8caf350e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a126e81a-b62f-4e74-a4a3-a17a15269801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a126e81a-b62f-4e74-a4a3-a17a15269801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b33dc96-edef-4e81-a476-48da550d6b7f', 'volume_name': 'volume-2b33dc96-edef-4e81-a476-48da550d6b7f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e145a1f5-7c4d-4323-bb0e-e1aa2379b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e145a1f5-7c4d-4323-bb0e-e1aa2379b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c5aff3-678a-421c-a6af-238eb5827904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:24 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Volume 2b33dc96-edef-4e81-a476-48da550d6b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b33dc96-edef-4e81-a476-48da550d6b7f', 'volume_size': 1} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1396787719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b33dc96-edef-4e81-a476-48da550d6b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77cb9cb57ef4816ad408137fb01fd5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:24Z,use_quota=True,user_id='dc43953313ec40b6afd61ce22dd8b5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Creating volume 2b33dc96-edef-4e81-a476-48da550d6b7f {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:55:24 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:55:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:24 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f 1073741824 Aug 26 18:55:24 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:25 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f 1073741824" returned: 0 in 0.734s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:25 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f Aug 26 18:55:25 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:25 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f" returned: 0 in 0.392s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:55:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c5aff3-678a-421c-a6af-238eb5827904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b33dc96-edef-4e81-a476-48da550d6b7f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc32a7a-fc12-4275-8ca6-10a797a46cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:25 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Volume volume-2b33dc96-edef-4e81-a476-48da550d6b7f (2b33dc96-edef-4e81-a476-48da550d6b7f): created successfully Aug 26 18:55:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc32a7a-fc12-4275-8ca6-10a797a46cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Flow 'volume_create_manager' (2bc6fb31-ad85-46c0-b8ec-d9e7671c6545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:25 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-58c71434-0e53-4a0a-964b-8e080fd6253b tempest-DeleteServersTestJSON-1186477065 None] Created volume successfully. Aug 26 18:55:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-bb8dc140-d511-40d6-80ef-3f2816fe459f req-c7b4318b-df65-482b-9ddb-3280e426471c tempest-DeleteServersTestJSON-1186477065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-bb8dc140-d511-40d6-80ef-3f2816fe459f req-c7b4318b-df65-482b-9ddb-3280e426471c tempest-DeleteServersTestJSON-1186477065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-bb8dc140-d511-40d6-80ef-3f2816fe459f req-c7b4318b-df65-482b-9ddb-3280e426471c tempest-DeleteServersTestJSON-1186477065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-bb8dc140-d511-40d6-80ef-3f2816fe459f req-c7b4318b-df65-482b-9ddb-3280e426471c tempest-DeleteServersTestJSON-1186477065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-2b33dc96-edef-4e81-a476-48da550d6b7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8060202-40f2-4f3c-bdb2-8998673e261e', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:55:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-bb8dc140-d511-40d6-80ef-3f2816fe459f req-c7b4318b-df65-482b-9ddb-3280e426471c tempest-DeleteServersTestJSON-1186477065 None] attachment_update completed successfully. Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Flow 'volume_create_manager' (787ea797-6049-45d4-98ce-419e27851ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528765a2-ed3b-4b7b-878f-c4e6ebe9af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528765a2-ed3b-4b7b-878f-c4e6ebe9af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1350431562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee96d5ae-558a-453a-8b5f-1753a9eda170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44711533a2924301b54306b7cef8b96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:30Z,use_quota=True,user_id='43120140701b4cf2acbeb4760e643e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(944cb682-d2c0-4d54-84a6-cdb0e517dc48),volume_type_id=944cb682-d2c0-4d54-84a6-cdb0e517dc48)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44401356-6028-4c0e-a939-61e16decf1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44401356-6028-4c0e-a939-61e16decf1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0949c0d8-6802-4e88-9346-926b80e59e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0949c0d8-6802-4e88-9346-926b80e59e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee96d5ae-558a-453a-8b5f-1753a9eda170', 'volume_name': 'volume-ee96d5ae-558a-453a-8b5f-1753a9eda170', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30b4280-6d71-467d-92bf-aef5d4998562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30b4280-6d71-467d-92bf-aef5d4998562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb6b975-40db-4c3d-bd51-f2212aabe4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:29 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Volume ee96d5ae-558a-453a-8b5f-1753a9eda170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee96d5ae-558a-453a-8b5f-1753a9eda170', 'volume_size': 1} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1350431562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee96d5ae-558a-453a-8b5f-1753a9eda170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44711533a2924301b54306b7cef8b96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:30Z,use_quota=True,user_id='43120140701b4cf2acbeb4760e643e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(944cb682-d2c0-4d54-84a6-cdb0e517dc48),volume_type_id=944cb682-d2c0-4d54-84a6-cdb0e517dc48)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Creating volume ee96d5ae-558a-453a-8b5f-1753a9eda170 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:55:29 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:55:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:30 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 1073741824 Aug 26 18:55:30 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:30 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 1073741824" returned: 0 in 0.603s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:30 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 Aug 26 18:55:30 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:31 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170" returned: 0 in 0.402s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:55:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb6b975-40db-4c3d-bd51-f2212aabe4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee96d5ae-558a-453a-8b5f-1753a9eda170', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021fada2-065f-49f9-b4b9-09df5a6f7a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Volume volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 (ee96d5ae-558a-453a-8b5f-1753a9eda170): created successfully Aug 26 18:55:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021fada2-065f-49f9-b4b9-09df5a6f7a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Flow 'volume_create_manager' (787ea797-6049-45d4-98ce-419e27851ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0942d3ac-7f41-45e4-bb7d-60e9e57fa966 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Created volume successfully. Aug 26 18:55:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-4e0cc4f6-3cd4-4202-8538-803fa777e5e7 req-802a6615-f038-410a-8580-68b852d54687 tempest-DeleteServersTestJSON-1186477065 None] Terminate volume connection completed successfully. Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-4e0cc4f6-3cd4-4202-8538-803fa777e5e7 req-802a6615-f038-410a-8580-68b852d54687 tempest-DeleteServersTestJSON-1186477065 None] Deleting attachment f8060202-40f2-4f3c-bdb2-8998673e261e. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c457ac09-af5d-4dbd-a7a7-846e474ed242 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c457ac09-af5d-4dbd-a7a7-846e474ed242 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c457ac09-af5d-4dbd-a7a7-846e474ed242 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c457ac09-af5d-4dbd-a7a7-846e474ed242 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c457ac09-af5d-4dbd-a7a7-846e474ed242 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c457ac09-af5d-4dbd-a7a7-846e474ed242 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:32 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:55:32 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:32 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c457ac09-af5d-4dbd-a7a7-846e474ed242 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.509s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-c457ac09-af5d-4dbd-a7a7-846e474ed242 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:55:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c457ac09-af5d-4dbd-a7a7-846e474ed242 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Retype volume completed successfully. Aug 26 18:55:32 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Flow 'volume_create_manager' (62b460c1-6eab-4bcd-a356-7d43fb4e0d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760e5bc0-f82c-4c00-9c46-7d99842065b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Acquiring lock "cinder-ee96d5ae-558a-453a-8b5f-1753a9eda170-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760e5bc0-f82c-4c00-9c46-7d99842065b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1580804658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98607ef-610d-4c3d-986c-e088e2a3a6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f9b3e22514600904c6d110a9b5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:33Z,use_quota=True,user_id='d4ddde0e83404ee58b66f01c685cb815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bc66be-5414-40a6-936b-009c2a42b57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bc66be-5414-40a6-936b-009c2a42b57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6e9776-9a17-4539-b112-8183a939ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6e9776-9a17-4539-b112-8183a939ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98607ef-610d-4c3d-986c-e088e2a3a6f6', 'volume_name': 'volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1143dec-c510-43d7-9bb0-dadaee25fbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1143dec-c510-43d7-9bb0-dadaee25fbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95137258-6c86-49fe-9203-92ca74410d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Volume a98607ef-610d-4c3d-986c-e088e2a3a6f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6', 'volume_size': 1} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1580804658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98607ef-610d-4c3d-986c-e088e2a3a6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f9b3e22514600904c6d110a9b5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:33Z,use_quota=True,user_id='d4ddde0e83404ee58b66f01c685cb815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Creating volume a98607ef-610d-4c3d-986c-e088e2a3a6f6 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:55:33 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "cinder-ee96d5ae-558a-453a-8b5f-1753a9eda170-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:55:33 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 1073741824 Aug 26 18:55:33 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Acquiring lock "cinder-quobyte-ee96d5ae-558a-453a-8b5f-1753a9eda170" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "cinder-quobyte-ee96d5ae-558a-453a-8b5f-1753a9eda170" acquired by "delete_volume" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d69762a-8512-4d79-af9a-938b4e019061]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:33 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 Aug 26 18:55:33 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:33 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 1073741824" returned: 0 in 0.452s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:33 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170" returned: 0 in 0.371s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:33 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170 Aug 26 18:55:33 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:33 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 Aug 26 18:55:33 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:33 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ee96d5ae-558a-453a-8b5f-1753a9eda170" returned: 0 in 0.255s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "cinder-quobyte-ee96d5ae-558a-453a-8b5f-1753a9eda170" released by "delete_volume" :: held 0.670s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:55:33 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6" returned: 0 in 0.260s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95137258-6c86-49fe-9203-92ca74410d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e437124-616f-49c1-b217-1857d6b045da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:33 devstack cinder-volume[93671]: WARNING cinder.quota [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:55:33 devstack cinder-volume[93671]: WARNING cinder.quota [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:55:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Volume volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 (a98607ef-610d-4c3d-986c-e088e2a3a6f6): created successfully Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e437124-616f-49c1-b217-1857d6b045da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Flow 'volume_create_manager' (62b460c1-6eab-4bcd-a356-7d43fb4e0d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Created reservations ['776b4421-377f-481d-bde9-fd1747ca43bd', '4b869238-fe79-46dd-a8fb-e92b4656dc1e', '48d667dc-904b-4373-a6a8-df1574691415', 'f36d5069-6f7d-41b1-bec6-0c996979b70c'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:55:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f90d71b6-dd23-467d-baed-4e2b62883f2c tempest-AttachVolumeNegativeTest-2019027492 None] Created volume successfully. Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:34 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:55:34 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:34 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.261s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:55:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Deleted volume successfully. Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-529635de-e3b7-44dc-a053-d9a7ed63a885 tempest-VolumeRetypeWithoutMigrationTest-1725571669 None] Lock "cinder-ee96d5ae-558a-453a-8b5f-1753a9eda170-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Acquiring lock "cinder-2b33dc96-edef-4e81-a476-48da550d6b7f-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Lock "cinder-2b33dc96-edef-4e81-a476-48da550d6b7f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Acquiring lock "cinder-quobyte-2b33dc96-edef-4e81-a476-48da550d6b7f" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Lock "cinder-quobyte-2b33dc96-edef-4e81-a476-48da550d6b7f" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f85725-ca62-4646-bab4-6661909c98aa]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:34 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f Aug 26 18:55:34 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:34 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f" returned: 0 in 0.388s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:34 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f Aug 26 18:55:34 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:35 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b33dc96-edef-4e81-a476-48da550d6b7f" returned: 0 in 0.279s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Lock "cinder-quobyte-2b33dc96-edef-4e81-a476-48da550d6b7f" released by "delete_volume" :: held 0.715s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Created reservations ['ae142c75-6d03-4a6b-85fa-9a1382a77745', '946df9da-aefb-4146-84ea-fcd59dddd504', 'e3a83039-0d94-4b35-92f7-03f00b3ae079', 'b32276ae-893e-4170-8e2c-0ed43780dd8c'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:35 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:55:35 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:35 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.353s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:55:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Deleted volume successfully. Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b86357e0-7066-4748-bb4c-73cd54a121ea tempest-DeleteServersTestJSON-1186477065 None] Lock "cinder-2b33dc96-edef-4e81-a476-48da550d6b7f-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-b648898e-bc91-460c-b5f5-640c5263c81e req-932ad0fd-4bbb-4495-91de-dc95fc50b861 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-b648898e-bc91-460c-b5f5-640c5263c81e req-932ad0fd-4bbb-4495-91de-dc95fc50b861 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-b648898e-bc91-460c-b5f5-640c5263c81e req-932ad0fd-4bbb-4495-91de-dc95fc50b861 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-b648898e-bc91-460c-b5f5-640c5263c81e req-932ad0fd-4bbb-4495-91de-dc95fc50b861 tempest-AttachVolumeNegativeTest-2019027492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed38e6f1-0344-4329-8669-21715468bfe6', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:55:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-b648898e-bc91-460c-b5f5-640c5263c81e req-932ad0fd-4bbb-4495-91de-dc95fc50b861 tempest-AttachVolumeNegativeTest-2019027492 None] attachment_update completed successfully. Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Flow 'volume_create_manager' (ca255a9a-dd6e-41c6-95bb-647c81f5b61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64136d99-4280-4a00-adf3-27de09a96503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64136d99-4280-4a00-adf3-27de09a96503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-48649273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fafc042-e0e9-43fb-9b1e-1e788707df55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f5d982a8354fa58a1d153ddf06c3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:42Z,use_quota=True,user_id='9d258f56fbe741f4a10ed64513c78a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee00178e-96f7-42d4-9735-6f88312f73e7),volume_type_id=ee00178e-96f7-42d4-9735-6f88312f73e7)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6037af7c-6abf-4693-be8d-b14c7d610b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6037af7c-6abf-4693-be8d-b14c7d610b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca273c8-0429-4a51-a205-146b761bf937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca273c8-0429-4a51-a205-146b761bf937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fafc042-e0e9-43fb-9b1e-1e788707df55', 'volume_name': 'volume-8fafc042-e0e9-43fb-9b1e-1e788707df55', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae46c2e-a5d5-4ff6-ac4a-46e9ca157bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae46c2e-a5d5-4ff6-ac4a-46e9ca157bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129aaf4f-ad0b-4d7f-bbb4-24c4a9d19a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:41 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Volume 8fafc042-e0e9-43fb-9b1e-1e788707df55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fafc042-e0e9-43fb-9b1e-1e788707df55', 'volume_size': 1} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-48649273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fafc042-e0e9-43fb-9b1e-1e788707df55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f5d982a8354fa58a1d153ddf06c3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:42Z,use_quota=True,user_id='9d258f56fbe741f4a10ed64513c78a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee00178e-96f7-42d4-9735-6f88312f73e7),volume_type_id=ee00178e-96f7-42d4-9735-6f88312f73e7)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Creating volume 8fafc042-e0e9-43fb-9b1e-1e788707df55 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:55:41 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:55:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:41 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 1073741824 Aug 26 18:55:41 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:42 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 1073741824" returned: 0 in 0.581s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:42 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 Aug 26 18:55:42 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:42 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55" returned: 0 in 0.410s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:55:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129aaf4f-ad0b-4d7f-bbb4-24c4a9d19a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fafc042-e0e9-43fb-9b1e-1e788707df55', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c4e676-e7de-4257-8056-8c131171dec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:42 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Volume volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 (8fafc042-e0e9-43fb-9b1e-1e788707df55): created successfully Aug 26 18:55:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c4e676-e7de-4257-8056-8c131171dec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Flow 'volume_create_manager' (ca255a9a-dd6e-41c6-95bb-647c81f5b61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:42 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0bfb7f2c-aaef-4d23-81de-90a8bb599231 tempest-VolumeTypesAccessTest-1953814252 None] Created volume successfully. Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Flow 'volume_create_manager' (5beb113e-054c-47da-8dcb-07402a5f41c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8390890-88fd-49e1-bde9-d7c9ff0d5b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8390890-88fd-49e1-bde9-d7c9ff0d5b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2013289908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d220e27-ad48-4222-a58a-273790312312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01ecaf5c5664c23886df7bf1d4d104d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:43Z,use_quota=True,user_id='f41b9d2283c84769b247d19a67110bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef09940-3601-48e7-b51b-83cb2c9ebc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef09940-3601-48e7-b51b-83cb2c9ebc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aec4bc9-32c8-4c6a-854c-788448d4bff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aec4bc9-32c8-4c6a-854c-788448d4bff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d220e27-ad48-4222-a58a-273790312312', 'volume_name': 'volume-2d220e27-ad48-4222-a58a-273790312312', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45a3b95-cad6-4e55-9879-627abff41c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45a3b95-cad6-4e55-9879-627abff41c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c8b078-28ee-499e-a8c6-7f41a0cfb3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:43 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Volume 2d220e27-ad48-4222-a58a-273790312312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d220e27-ad48-4222-a58a-273790312312', 'volume_size': 1} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2013289908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d220e27-ad48-4222-a58a-273790312312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01ecaf5c5664c23886df7bf1d4d104d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:55:43Z,use_quota=True,user_id='f41b9d2283c84769b247d19a67110bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Creating volume 2d220e27-ad48-4222-a58a-273790312312 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:55:43 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:43 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312 1073741824 Aug 26 18:55:43 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Acquiring lock "cinder-8fafc042-e0e9-43fb-9b1e-1e788707df55-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Lock "cinder-8fafc042-e0e9-43fb-9b1e-1e788707df55-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Acquiring lock "cinder-quobyte-8fafc042-e0e9-43fb-9b1e-1e788707df55" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:55:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Lock "cinder-quobyte-8fafc042-e0e9-43fb-9b1e-1e788707df55" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd81ef2-b760-49f5-9abe-b9b905c9c4eb]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:44 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312 1073741824" returned: 0 in 0.722s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:44 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 Aug 26 18:55:44 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:44 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312 Aug 26 18:55:44 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:44 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:44 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55" returned: 0 in 0.578s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:44 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55 Aug 26 18:55:44 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c8b078-28ee-499e-a8c6-7f41a0cfb3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d220e27-ad48-4222-a58a-273790312312', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61324645-1d3d-4d7e-a695-778f79c2575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:55:44 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Volume volume-2d220e27-ad48-4222-a58a-273790312312 (2d220e27-ad48-4222-a58a-273790312312): created successfully Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61324645-1d3d-4d7e-a695-778f79c2575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Flow 'volume_create_manager' (5beb113e-054c-47da-8dcb-07402a5f41c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:55:44 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-918ec5ce-d876-4357-8cb4-2eea76e82768 tempest-AttachVolumeTestJSON-870733790 None] Created volume successfully. Aug 26 18:55:44 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8fafc042-e0e9-43fb-9b1e-1e788707df55" returned: 0 in 0.278s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Lock "cinder-quobyte-8fafc042-e0e9-43fb-9b1e-1e788707df55" released by "delete_volume" :: held 0.939s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:55:44 devstack cinder-volume[93671]: WARNING cinder.quota [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2018976174 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2018976174, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:55:44 devstack cinder-volume[93671]: WARNING cinder.quota [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2018976174 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2018976174, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Created reservations ['1bff9096-d04d-4021-8bdf-bd4c36d7beec', 'd7110a05-4130-46e0-ba08-289864d69a94', '52834bae-d58f-49c5-aa16-ee42fe8e6fc8', 'ebaab5d6-ccce-4fc8-9b9c-a953d5126971'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:45 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:55:45 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:45 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.315s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:55:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Deleted volume successfully. Aug 26 18:55:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8733b7f9-4154-4a3c-9103-4d5a75822a9a tempest-VolumeTypesAccessTest-1953814252 None] Lock "cinder-8fafc042-e0e9-43fb-9b1e-1e788707df55-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:55:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-92191523-32bd-4798-a668-be76c75c4caa req-a0ddb96b-6c08-4a38-adaf-daadcffe1eab tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-92191523-32bd-4798-a668-be76c75c4caa req-a0ddb96b-6c08-4a38-adaf-daadcffe1eab tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-92191523-32bd-4798-a668-be76c75c4caa req-a0ddb96b-6c08-4a38-adaf-daadcffe1eab tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-92191523-32bd-4798-a668-be76c75c4caa req-a0ddb96b-6c08-4a38-adaf-daadcffe1eab tempest-AttachVolumeTestJSON-870733790 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-2d220e27-ad48-4222-a58a-273790312312', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44530f82-9819-495e-997c-701ddfc6564f', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:55:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-92191523-32bd-4798-a668-be76c75c4caa req-a0ddb96b-6c08-4a38-adaf-daadcffe1eab tempest-AttachVolumeTestJSON-870733790 None] attachment_update completed successfully. Aug 26 18:55:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:55:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:55:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:55:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:55:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:55:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:55:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:55:54 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:55:54 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:55:54 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Aug 26 18:55:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.373s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:55:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:55:56 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=59,cinder:INSERT=13,cinder:DELETE=5,cinder:SELECT=52 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:55:56 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=67,cinder:UPDATE=59,cinder:INSERT=9,cinder:DELETE=5 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:56:02 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:56:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Flow 'volume_create_manager' (78cc57dd-46ef-449d-a81e-6dc7708cc425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f1920e-a023-4dc4-921a-55b58863db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f1920e-a023-4dc4-921a-55b58863db6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004997456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eaf619-c889-4b5f-980f-03e5b1c3aa5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddfc0ce77a54963a54011364a9bd7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:03Z,use_quota=True,user_id='b1d9c55028044ee28d81b8ff65c0a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9078d29c-cd78-431e-82f1-a607ed8d37d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9078d29c-cd78-431e-82f1-a607ed8d37d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf0df04-6d43-42ec-a967-50063e590f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf0df04-6d43-42ec-a967-50063e590f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4eaf619-c889-4b5f-980f-03e5b1c3aa5d', 'volume_name': 'volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed861ce-aeb0-4ef9-a24c-53518af2fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed861ce-aeb0-4ef9-a24c-53518af2fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1284337f-1676-4872-aaf0-616474593486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:03 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Volume f4eaf619-c889-4b5f-980f-03e5b1c3aa5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d', 'volume_size': 1} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004997456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eaf619-c889-4b5f-980f-03e5b1c3aa5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddfc0ce77a54963a54011364a9bd7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:03Z,use_quota=True,user_id='b1d9c55028044ee28d81b8ff65c0a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Creating volume f4eaf619-c889-4b5f-980f-03e5b1c3aa5d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:56:03 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:03 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d 1073741824 Aug 26 18:56:03 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:03 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d 1073741824" returned: 0 in 0.504s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:03 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d Aug 26 18:56:03 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:04 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d" returned: 0 in 0.409s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:56:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1284337f-1676-4872-aaf0-616474593486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263192cb-d84d-4adf-8490-c77f7c845c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:04 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Volume volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d (f4eaf619-c889-4b5f-980f-03e5b1c3aa5d): created successfully Aug 26 18:56:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263192cb-d84d-4adf-8490-c77f7c845c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Flow 'volume_create_manager' (78cc57dd-46ef-449d-a81e-6dc7708cc425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:04 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8464f5bf-ac3b-405a-af4f-5e6485decff7 tempest-VolumesListAdminTestJSON-1367123382 None] Created volume successfully. Aug 26 18:56:05 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Flow 'volume_create_manager' (05f7ff5c-578f-4fc5-8a68-892554245376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baa4f64-c667-48c0-b39f-83fbcc8991c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baa4f64-c667-48c0-b39f-83fbcc8991c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-340066028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f101fd-19ec-4601-ac3d-47fb36f0a1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddfc0ce77a54963a54011364a9bd7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:06Z,use_quota=True,user_id='b1d9c55028044ee28d81b8ff65c0a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a105112-f017-488e-9afa-8918f8f08328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a105112-f017-488e-9afa-8918f8f08328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd965ad6-6b03-43ff-89cc-78e44b0a0634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd965ad6-6b03-43ff-89cc-78e44b0a0634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f101fd-19ec-4601-ac3d-47fb36f0a1ac', 'volume_name': 'volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eed004f-5f02-42c8-b2ef-931700e8a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eed004f-5f02-42c8-b2ef-931700e8a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe74b1c8-bb54-4526-a73f-da694ade0250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:06 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Volume e8f101fd-19ec-4601-ac3d-47fb36f0a1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac', 'volume_size': 1} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-340066028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f101fd-19ec-4601-ac3d-47fb36f0a1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddfc0ce77a54963a54011364a9bd7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:06Z,use_quota=True,user_id='b1d9c55028044ee28d81b8ff65c0a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Creating volume e8f101fd-19ec-4601-ac3d-47fb36f0a1ac {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:56:06 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:06 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac 1073741824 Aug 26 18:56:06 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:06 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac 1073741824" returned: 0 in 0.643s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:06 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac Aug 26 18:56:06 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:07 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac" returned: 0 in 0.416s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:56:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe74b1c8-bb54-4526-a73f-da694ade0250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ba0cd2-858b-4799-854d-e751d4c27d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:07 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Volume volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac (e8f101fd-19ec-4601-ac3d-47fb36f0a1ac): created successfully Aug 26 18:56:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ba0cd2-858b-4799-854d-e751d4c27d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Flow 'volume_create_manager' (05f7ff5c-578f-4fc5-8a68-892554245376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:07 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2c605bfe-e39b-4e1e-80d8-e108978a51f3 tempest-VolumesListAdminTestJSON-1367123382 None] Created volume successfully. Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Flow 'volume_create_manager' (d14f4c71-7015-4704-8d6a-b70c4516238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29ef37a-70cd-402a-b4e6-5f3971d91c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29ef37a-70cd-402a-b4e6-5f3971d91c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1680986932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cf7530-f61a-48b1-a494-63cd4bf8ab74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddfc0ce77a54963a54011364a9bd7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:09Z,use_quota=True,user_id='b1d9c55028044ee28d81b8ff65c0a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100afd18-4a10-42a8-94d7-a17b40d0eff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100afd18-4a10-42a8-94d7-a17b40d0eff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64277976-425f-4bc9-99bc-a8607045d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64277976-425f-4bc9-99bc-a8607045d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0cf7530-f61a-48b1-a494-63cd4bf8ab74', 'volume_name': 'volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47881d63-3fb0-4b36-8069-3ef22e6ac8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47881d63-3fb0-4b36-8069-3ef22e6ac8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636186dc-4bfc-43a1-acc6-0596b5f78c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:08 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Volume d0cf7530-f61a-48b1-a494-63cd4bf8ab74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74', 'volume_size': 1} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1680986932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cf7530-f61a-48b1-a494-63cd4bf8ab74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddfc0ce77a54963a54011364a9bd7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:09Z,use_quota=True,user_id='b1d9c55028044ee28d81b8ff65c0a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Creating volume d0cf7530-f61a-48b1-a494-63cd4bf8ab74 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:56:08 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:56:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:08 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 1073741824 Aug 26 18:56:08 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:09 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 1073741824" returned: 0 in 0.983s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:09 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 Aug 26 18:56:09 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:10 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74" returned: 0 in 0.388s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:56:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636186dc-4bfc-43a1-acc6-0596b5f78c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7cba1f-58f6-4156-be20-8371f14fb167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:10 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Volume volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 (d0cf7530-f61a-48b1-a494-63cd4bf8ab74): created successfully Aug 26 18:56:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7cba1f-58f6-4156-be20-8371f14fb167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Flow 'volume_create_manager' (d14f4c71-7015-4704-8d6a-b70c4516238a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:10 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-23694219-81da-4beb-bca4-082593bdddd4 tempest-VolumesListAdminTestJSON-1367123382 None] Created volume successfully. Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Flow 'volume_create_manager' (fe2a214b-1219-4ba4-b2bf-970f62e629a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b20d9d-20bf-41cf-a3b6-a713e96f917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b20d9d-20bf-41cf-a3b6-a713e96f917e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98819c3-9024-479f-8d50-0d4a59a47dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0712a2fc7a437ba5680dcd314e52da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:12Z,use_quota=True,user_id='7ddc5a5e290348a9bc0866034dcfc48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec21b55-119f-4c90-acea-553af731e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec21b55-119f-4c90-acea-553af731e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aee257b-eeed-45f3-8687-83ac59b3b0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aee257b-eeed-45f3-8687-83ac59b3b0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98819c3-9024-479f-8d50-0d4a59a47dc0', 'volume_name': 'volume-b98819c3-9024-479f-8d50-0d4a59a47dc0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ed8448-0e03-47ea-81e9-ce8c0c8cab8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ed8448-0e03-47ea-81e9-ce8c0c8cab8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667bf97e-f5d5-4ec5-82a3-216c2657c2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:11 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Volume b98819c3-9024-479f-8d50-0d4a59a47dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98819c3-9024-479f-8d50-0d4a59a47dc0', 'volume_size': 1} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98819c3-9024-479f-8d50-0d4a59a47dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0712a2fc7a437ba5680dcd314e52da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:12Z,use_quota=True,user_id='7ddc5a5e290348a9bc0866034dcfc48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Creating volume b98819c3-9024-479f-8d50-0d4a59a47dc0 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:56:12 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:12 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 1073741824 Aug 26 18:56:12 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:12 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 1073741824" returned: 0 in 0.763s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:12 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 Aug 26 18:56:12 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:13 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0" returned: 0 in 0.370s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:56:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667bf97e-f5d5-4ec5-82a3-216c2657c2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98819c3-9024-479f-8d50-0d4a59a47dc0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90b608e-283e-4010-90ee-0ad8440c14a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Volume volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 (b98819c3-9024-479f-8d50-0d4a59a47dc0): created successfully Aug 26 18:56:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90b608e-283e-4010-90ee-0ad8440c14a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Flow 'volume_create_manager' (fe2a214b-1219-4ba4-b2bf-970f62e629a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ab6d6084-2108-4160-9e85-da68b0216c13 tempest-VolumesListAdminTestJSON-606783796 None] Created volume successfully. Aug 26 18:56:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Acquiring lock "cinder-b98819c3-9024-479f-8d50-0d4a59a47dc0-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Lock "cinder-b98819c3-9024-479f-8d50-0d4a59a47dc0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Acquiring lock "cinder-quobyte-b98819c3-9024-479f-8d50-0d4a59a47dc0" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Lock "cinder-quobyte-b98819c3-9024-479f-8d50-0d4a59a47dc0" acquired by "delete_volume" :: waited 0.036s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:14 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[759f78eb-2635-4304-843f-123cab4c5e2e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:56:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:14 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 Aug 26 18:56:14 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "cinder-d0cf7530-f61a-48b1-a494-63cd4bf8ab74-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-d0cf7530-f61a-48b1-a494-63cd4bf8ab74-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "cinder-quobyte-d0cf7530-f61a-48b1-a494-63cd4bf8ab74" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-quobyte-d0cf7530-f61a-48b1-a494-63cd4bf8ab74" acquired by "delete_volume" :: waited 0.060s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:15 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaac273d-42ff-4791-9600-43f5b5bb8300]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:56:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:15 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0" returned: 0 in 0.989s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:15 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 Aug 26 18:56:15 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:15 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0 Aug 26 18:56:15 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:16 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74" returned: 0 in 0.893s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:16 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74 Aug 26 18:56:16 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:16 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b98819c3-9024-479f-8d50-0d4a59a47dc0" returned: 0 in 0.916s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Lock "cinder-quobyte-b98819c3-9024-479f-8d50-0d4a59a47dc0" released by "delete_volume" :: held 2.013s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Created reservations ['db653dc1-1c42-44fa-90ba-7a71dc8e242e', 'd36cc241-9b9d-4639-a048-9a4e63dfabf1', 'a3afbe2f-730a-4f57-b89a-2b3c607be85a', '22c90560-2ac7-48b0-8e85-e8227db5246f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:16 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:56:16 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:16 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0cf7530-f61a-48b1-a494-63cd4bf8ab74" returned: 0 in 0.669s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-quobyte-d0cf7530-f61a-48b1-a494-63cd4bf8ab74" released by "delete_volume" :: held 1.668s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Created reservations ['9743bf81-5546-4821-989d-8935ac7d5edc', '50d714f2-87bf-4959-ba69-be24a1fd8cc5', '6d4385ed-0445-4bbc-aa6c-d64c4aafc55f', '463f6461-f3a5-4935-aa88-d6677206c7dc'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:17 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:17 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.666s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:17 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:56:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Deleted volume successfully. Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-722e9637-74af-4c5e-aa68-a610e30a0e31 tempest-VolumesListAdminTestJSON-606783796 None] Lock "cinder-b98819c3-9024-479f-8d50-0d4a59a47dc0-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:17 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.410s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:56:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Deleted volume successfully. Aug 26 18:56:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-865cf553-f257-4e44-b141-7d6b32c37039 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-d0cf7530-f61a-48b1-a494-63cd4bf8ab74-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "cinder-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "cinder-quobyte-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-quobyte-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac" acquired by "delete_volume" :: waited 0.052s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:18 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c577d90-6423-453e-9333-84b737230435]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:56:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:18 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac Aug 26 18:56:18 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:19 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac" returned: 0 in 0.540s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:19 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac Aug 26 18:56:19 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:19 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac" returned: 0 in 0.286s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-quobyte-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac" released by "delete_volume" :: held 0.889s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Created reservations ['78864906-80ff-402e-a0c8-6161c24776b5', 'b1956015-427b-4590-af2d-a11bd8f493da', '7616c07b-cbba-40c3-be56-2e8d66c49ed3', 'acfb0ec0-c354-4b51-8024-acd200e58cfe'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:19 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:56:19 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:19 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.275s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:56:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Deleted volume successfully. Aug 26 18:56:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4a2a4f7a-5580-43ee-bab9-5c26058bd684 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-e8f101fd-19ec-4601-ac3d-47fb36f0a1ac-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "cinder-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "cinder-quobyte-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-quobyte-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[97247f5a-f8f9-42ef-a36d-2224699c3ba2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:56:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:21 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d Aug 26 18:56:21 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-23dee93e-169d-42a1-8031-908f0ebb9ac3 req-a8826d9f-ffe3-425f-a044-aa631c76f52d tempest-AttachVolumeNegativeTest-2019027492 None] Terminate volume connection completed successfully. Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-23dee93e-169d-42a1-8031-908f0ebb9ac3 req-a8826d9f-ffe3-425f-a044-aa631c76f52d tempest-AttachVolumeNegativeTest-2019027492 None] Deleting attachment ed38e6f1-0344-4329-8669-21715468bfe6. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:56:21 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d" returned: 0 in 0.461s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:21 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d Aug 26 18:56:21 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:21 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d" returned: 0 in 0.254s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-quobyte-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d" released by "delete_volume" :: held 0.767s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Created reservations ['7e7d9746-d3be-4b6b-819f-ec471e58cd1f', '6d192b60-fee3-4a27-a7b1-e9f9a5392772', '5c8249ca-8d95-433c-8881-b88d8fbe548b', '5852baf2-784d-4e31-b5c0-164e082bcc81'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:21 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:56:21 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:22 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.443s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:22 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:56:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Deleted volume successfully. Aug 26 18:56:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5938f27f-8e5e-4c29-a481-717907edad67 tempest-VolumesListAdminTestJSON-1367123382 None] Lock "cinder-f4eaf619-c889-4b5f-980f-03e5b1c3aa5d-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:27 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:56:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Flow 'volume_create_manager' (ad5c10bb-8d91-480d-a60f-ab7119a78e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0788a0a7-9959-4e17-ad82-df8ec6e472e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0788a0a7-9959-4e17-ad82-df8ec6e472e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1758473490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7042a06-6c9c-427a-b5fa-62f3d86e0970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d139c68fdd24426807b7bbe5b873bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:28Z,use_quota=True,user_id='894aabe6e5f540178f46daa805175c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9135a8a0-93a8-4485-9d6d-5eb920196c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9135a8a0-93a8-4485-9d6d-5eb920196c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7341724-dbb6-4864-b5f3-706ca9020873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7341724-dbb6-4864-b5f3-706ca9020873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7042a06-6c9c-427a-b5fa-62f3d86e0970', 'volume_name': 'volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3865e1a0-8e23-4ea4-8f24-aae3b9208fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3865e1a0-8e23-4ea4-8f24-aae3b9208fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89ebcb2-83db-4bbe-bd6b-1edd8969f2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:28 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Volume b7042a06-6c9c-427a-b5fa-62f3d86e0970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970', 'volume_size': 1} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1758473490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7042a06-6c9c-427a-b5fa-62f3d86e0970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d139c68fdd24426807b7bbe5b873bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:28Z,use_quota=True,user_id='894aabe6e5f540178f46daa805175c85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Creating volume b7042a06-6c9c-427a-b5fa-62f3d86e0970 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:56:28 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:28 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 1073741824 Aug 26 18:56:28 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:28 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 1073741824" returned: 0 in 0.538s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:28 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 Aug 26 18:56:28 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-55777b7b-a707-49e3-aef8-917ddf3c360d req-e20f6aca-86a6-43a4-86ce-fc8098467221 tempest-AttachVolumeTestJSON-870733790 None] Terminate volume connection completed successfully. Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-55777b7b-a707-49e3-aef8-917ddf3c360d req-e20f6aca-86a6-43a4-86ce-fc8098467221 tempest-AttachVolumeTestJSON-870733790 None] Deleting attachment 44530f82-9819-495e-997c-701ddfc6564f. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:56:28 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970" returned: 0 in 0.307s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89ebcb2-83db-4bbe-bd6b-1edd8969f2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b380bcdc-2868-4a08-8cee-2b620dfb2442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:28 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Volume volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 (b7042a06-6c9c-427a-b5fa-62f3d86e0970): created successfully Aug 26 18:56:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b380bcdc-2868-4a08-8cee-2b620dfb2442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Flow 'volume_create_manager' (ad5c10bb-8d91-480d-a60f-ab7119a78e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0d3d52fd-ba12-417d-86ec-6665e017447c tempest-SnapshotMetadataTestJSON-107928762 None] Created volume successfully. Aug 26 18:56:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Creating offline snapshot 85fd86ab-3ca1-4acf-b4c4-d610f7551742 of volume b7042a06-6c9c-427a-b5fa-62f3d86e0970 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:56:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0c833a-96d8-4aa2-9b89-95a05f95c99b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:56:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:30 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 Aug 26 18:56:30 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:30 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970" returned: 0 in 0.403s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:30 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 1G Aug 26 18:56:30 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:30 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 1G" returned: 0 in 0.387s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:30 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 Aug 26 18:56:30 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:31 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742" returned: 0 in 0.334s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:31 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 is being set with open permissions: ugo+rw Aug 26 18:56:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:31 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 Aug 26 18:56:31 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:31 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742" returned: 0 in 0.242s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:31 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.info Aug 26 18:56:31 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:31 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.info" returned: 0 in 0.250s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:31 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.info is being set with open permissions: ugo+rw Aug 26 18:56:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:31 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.info Aug 26 18:56:31 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:32 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.info" returned: 0 in 0.251s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.147s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:36 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-59636d71-83a9-4d58-be02-07614a5db743 tempest-SnapshotMetadataTestJSON-107928762 None] Create snapshot completed successfully Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Flow 'volume_create_manager' (7ae63231-33bf-45b8-a88d-c4df95e7e82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e3da5d-d9a0-49ff-8b31-143b4f3c60c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Acquiring lock "cinder-85fd86ab-3ca1-4acf-b4c4-d610f7551742-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e3da5d-d9a0-49ff-8b31-143b4f3c60c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-377662275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f800a3-c9d8-4b22-b919-9e8f6ab7be3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d419c0c0bb404607ad4a484390cab93a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:39Z,use_quota=True,user_id='1ee6b0fa6e7d46a3bbafa835b9eaf38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1d7173-0e63-4084-97ed-93e7f71f7acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1d7173-0e63-4084-97ed-93e7f71f7acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad8ae7b-d9ae-40f2-95a6-215ef0184600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad8ae7b-d9ae-40f2-95a6-215ef0184600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f800a3-c9d8-4b22-b919-9e8f6ab7be3f', 'volume_name': 'volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7a22d2-7a09-471f-a6f4-66227d9ac057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7a22d2-7a09-471f-a6f4-66227d9ac057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b44a143-827f-4e2e-a46f-06a99b20d82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:39 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Volume 18f800a3-c9d8-4b22-b919-9e8f6ab7be3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f', 'volume_size': 1} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-377662275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f800a3-c9d8-4b22-b919-9e8f6ab7be3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d419c0c0bb404607ad4a484390cab93a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:39Z,use_quota=True,user_id='1ee6b0fa6e7d46a3bbafa835b9eaf38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Creating volume 18f800a3-c9d8-4b22-b919-9e8f6ab7be3f {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:56:39 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-85fd86ab-3ca1-4acf-b4c4-d610f7551742-delete_snapshot" acquired by "delete_snapshot" :: waited 0.122s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Acquiring lock "cinder-quobyte-b7042a06-6c9c-427a-b5fa-62f3d86e0970" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:39 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f 1073741824 Aug 26 18:56:39 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-quobyte-b7042a06-6c9c-427a-b5fa-62f3d86e0970" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Acquiring lock "cinder-quobyte-85fd86ab-3ca1-4acf-b4c4-d610f7551742" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-quobyte-85fd86ab-3ca1-4acf-b4c4-d610f7551742" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Deleting offline snapshot 85fd86ab-3ca1-4acf-b4c4-d610f7551742 of volume b7042a06-6c9c-427a-b5fa-62f3d86e0970 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] snapshot_file for this snap is: volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[98089160-0c09-4705-a105-da1317272717]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:56:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:39 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 Aug 26 18:56:39 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:40 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f 1073741824" returned: 0 in 1.036s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:40 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742" returned: 0 in 0.837s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16b50f1-bd14-4b19-91ab-f79a0ace13e8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:40 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f Aug 26 18:56:40 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:40 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 Aug 26 18:56:40 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:40 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f" returned: 0 in 0.461s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b44a143-827f-4e2e-a46f-06a99b20d82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829d7f7e-c0ed-4dde-9a1f-9031452338bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:40 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Volume volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f (18f800a3-c9d8-4b22-b919-9e8f6ab7be3f): created successfully Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829d7f7e-c0ed-4dde-9a1f-9031452338bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Flow 'volume_create_manager' (7ae63231-33bf-45b8-a88d-c4df95e7e82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-10a00e1a-5003-46d6-96d3-ccfb14196852 tempest-ServerActionsTestOtherA-761705016 None] Created volume successfully. Aug 26 18:56:41 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970" returned: 0 in 0.636s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:41 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 Aug 26 18:56:41 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:41 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742" returned: 0 in 0.544s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:41 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742 Aug 26 18:56:41 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:41 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970.85fd86ab-3ca1-4acf-b4c4-d610f7551742" returned: 0 in 0.333s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-quobyte-85fd86ab-3ca1-4acf-b4c4-d610f7551742" released by "_delete_snapshot" :: held 2.640s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-quobyte-b7042a06-6c9c-427a-b5fa-62f3d86e0970" released by "delete_snapshot" :: held 2.688s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:42 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Created reservations ['566d93cb-da4d-43a6-97ea-7cd94a58c8a6', '85d98146-b56f-46af-a994-8a3bc81a0f04', '9212e0a3-ea26-44df-80d4-a5fe17786eef', '6e2a8b34-6ac5-4f7b-9a45-bc80b87ea921'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:56:42 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Delete snapshot completed successfully. Aug 26 18:56:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c184f304-e4d7-49e8-a48b-f9466e9c9df5 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-85fd86ab-3ca1-4acf-b4c4-d610f7551742-delete_snapshot" released by "delete_snapshot" :: held 2.968s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Acquiring lock "cinder-b7042a06-6c9c-427a-b5fa-62f3d86e0970-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-b7042a06-6c9c-427a-b5fa-62f3d86e0970-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Acquiring lock "cinder-quobyte-b7042a06-6c9c-427a-b5fa-62f3d86e0970" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:56:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-quobyte-b7042a06-6c9c-427a-b5fa-62f3d86e0970" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:56:42 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d16899-3fca-450b-a093-8003334f221d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:56:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:43 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 Aug 26 18:56:43 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:43 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970" returned: 0 in 0.649s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:43 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970 Aug 26 18:56:43 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:44 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b7042a06-6c9c-427a-b5fa-62f3d86e0970" returned: 0 in 0.802s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-quobyte-b7042a06-6c9c-427a-b5fa-62f3d86e0970" released by "delete_volume" :: held 1.564s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:44 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Created reservations ['2e4b7dee-64d3-4a4a-a7e9-bd40150955b6', 'ded689e1-50b1-4f15-a9c5-95b921a37e71', 'cde25b58-7143-4de2-bf87-9ebfcc8d1f17', '93122769-3192-4e30-860e-2a5df957d1d7'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:56:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:44 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:56:44 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:45 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.697s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:45 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:56:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Deleted volume successfully. Aug 26 18:56:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-11703ce5-80a1-457c-93c8-173d21bc91e3 tempest-SnapshotMetadataTestJSON-107928762 None] Lock "cinder-b7042a06-6c9c-427a-b5fa-62f3d86e0970-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Flow 'volume_create_manager' (c0939677-d704-402b-bdc1-ff96717555f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f55fec-4314-47c1-8246-6047238bee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f55fec-4314-47c1-8246-6047238bee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-192817909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d9edc5-6286-4e31-8271-bb0422ff87be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686266d2cbd43068bfc91b889d7d563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:52Z,use_quota=True,user_id='7cc273cec5c0463eb5116069abb50af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0677a437-7365-4104-9732-e8540ae0cbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0677a437-7365-4104-9732-e8540ae0cbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5634a12e-e091-42cd-875e-91961fe5cbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5634a12e-e091-42cd-875e-91961fe5cbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d9edc5-6286-4e31-8271-bb0422ff87be', 'volume_name': 'volume-63d9edc5-6286-4e31-8271-bb0422ff87be', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595c2d7a-1edf-49a4-9d5e-eb4655d1a4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595c2d7a-1edf-49a4-9d5e-eb4655d1a4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50b9d18-d922-45c5-b235-4f70ea62eb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:51 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Volume 63d9edc5-6286-4e31-8271-bb0422ff87be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d9edc5-6286-4e31-8271-bb0422ff87be', 'volume_size': 1} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-192817909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d9edc5-6286-4e31-8271-bb0422ff87be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686266d2cbd43068bfc91b889d7d563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:56:52Z,use_quota=True,user_id='7cc273cec5c0463eb5116069abb50af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Creating volume 63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:56:51 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:56:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:51 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be 1073741824 Aug 26 18:56:51 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:53 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be 1073741824" returned: 0 in 1.154s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:53 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be Aug 26 18:56:53 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:53 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be" returned: 0 in 0.882s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50b9d18-d922-45c5-b235-4f70ea62eb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d9edc5-6286-4e31-8271-bb0422ff87be', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc4cc61-f1e9-4292-a8c0-c46ba669c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:56:54 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Volume volume-63d9edc5-6286-4e31-8271-bb0422ff87be (63d9edc5-6286-4e31-8271-bb0422ff87be): created successfully Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc4cc61-f1e9-4292-a8c0-c46ba669c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Flow 'volume_create_manager' (c0939677-d704-402b-bdc1-ff96717555f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:56:54 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c10d7016-70f3-498a-afbc-4e5b267bc383 tempest-VolumesSnapshotListTestJSON-1730425860 None] Created volume successfully. Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:54 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:56:54 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:55 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.597s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 8 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Creating offline snapshot b6638292-de5d-4d51-8ea7-96c2d1ee0dcd of volume 63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfd373a-04bb-4346-925b-453bbccfde78]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:56:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:55 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be Aug 26 18:56:55 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:56 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be" returned: 0 in 0.576s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:56 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd 1G Aug 26 18:56:56 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:56 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd 1G" returned: 0 in 0.646s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d9edc5-6286-4e31-8271-bb0422ff87be -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:56 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d9edc5-6286-4e31-8271-bb0422ff87be -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd Aug 26 18:56:56 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:57 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d9edc5-6286-4e31-8271-bb0422ff87be -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" returned: 0 in 0.430s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:57 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd is being set with open permissions: ugo+rw Aug 26 18:56:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:57 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd Aug 26 18:56:57 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:58 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" returned: 0 in 0.631s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:58 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=73,cinder:SELECT=45,cinder:DELETE=8,cinder:INSERT=13 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:56:58 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=60,cinder:INSERT=19,cinder:UPDATE=65,cinder:DELETE=5 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:56:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:58 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.info Aug 26 18:56:58 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:58 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.info" returned: 0 in 0.301s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:58 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.info is being set with open permissions: ugo+rw Aug 26 18:56:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:56:58 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.info Aug 26 18:56:58 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:56:58 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Aug 26 18:56:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.info" returned: 0 in 0.395s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:56:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.199s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:56:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-98f6a3ac-1f94-4500-972e-190bd267cb0a tempest-VolumesSnapshotListTestJSON-1730425860 None] Create snapshot completed successfully Aug 26 18:57:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Creating offline snapshot c55dc7b9-cf17-43be-816a-fd9a0b728e4e of volume 63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:57:00 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde34228-1db9-4650-90bc-6f7c749cf7d9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:57:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:00 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd Aug 26 18:57:00 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:00 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" returned: 0 in 0.455s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d9edc5-6286-4e31-8271-bb0422ff87be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:57:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:00 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e 1G Aug 26 18:57:00 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:01 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e 1G" returned: 0 in 0.575s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:01 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e Aug 26 18:57:01 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:01 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e" returned: 0 in 0.358s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:01 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e is being set with open permissions: ugo+rw Aug 26 18:57:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:01 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e Aug 26 18:57:01 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:01 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e" returned: 0 in 0.246s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:01 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e5dc308e-4bbe-47e6-af28-b0b7f552276b tempest-VolumesSnapshotListTestJSON-1730425860 None] Create snapshot completed successfully Aug 26 18:57:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Creating offline snapshot 9619b730-4c9e-4101-8c9a-988f7b50f064 of volume 63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:57:02 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf9ee08-8228-473a-ad96-c3aa9f5bd607]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:57:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:02 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e Aug 26 18:57:02 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:02 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e" returned: 0 in 0.418s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d9edc5-6286-4e31-8271-bb0422ff87be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:57:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:03 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 1G Aug 26 18:57:03 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:03 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 1G" returned: 0 in 0.471s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:03 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 Aug 26 18:57:03 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:03 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064" returned: 0 in 0.304s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:03 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 is being set with open permissions: ugo+rw Aug 26 18:57:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:03 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 Aug 26 18:57:03 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:04 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064" returned: 0 in 0.290s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.595s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:04 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f1c83cf9-6422-4728-8f55-2c09614ff879 tempest-VolumesSnapshotListTestJSON-1730425860 None] Create snapshot completed successfully Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-9619b730-4c9e-4101-8c9a-988f7b50f064-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-9619b730-4c9e-4101-8c9a-988f7b50f064-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-quobyte-9619b730-4c9e-4101-8c9a-988f7b50f064" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-9619b730-4c9e-4101-8c9a-988f7b50f064" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Deleting offline snapshot 9619b730-4c9e-4101-8c9a-988f7b50f064 of volume 63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] snapshot_file for this snap is: volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d688ed-6edd-4a8a-982a-4bdb18f344b4]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:05 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 Aug 26 18:57:05 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:05 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064" returned: 0 in 0.372s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d9edc5-6286-4e31-8271-bb0422ff87be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f2c001-3465-48a0-83af-2c5c3a28385e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:57:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:06 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e Aug 26 18:57:06 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:06 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e" returned: 0 in 0.476s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d9edc5-6286-4e31-8271-bb0422ff87be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:57:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:06 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 Aug 26 18:57:06 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:07 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064" returned: 0 in 0.682s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:07 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064 Aug 26 18:57:07 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:07 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.9619b730-4c9e-4101-8c9a-988f7b50f064" returned: 0 in 0.320s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-9619b730-4c9e-4101-8c9a-988f7b50f064" released by "_delete_snapshot" :: held 1.954s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" released by "delete_snapshot" :: held 1.984s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:07 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Created reservations ['c893359b-aac2-42a5-9ced-6ae15a7b56b9', 'e63b5236-e00f-4eaf-9d81-dd04a538b0df', 'fe0e6cab-cd41-4c2b-9c62-4f1f09a6ca5b', '9b0caae1-2f2f-4d87-b026-8fe88a841447'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:57:07 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Delete snapshot completed successfully. Aug 26 18:57:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-132a5852-b802-49f3-81ed-1257ab62c57d tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-9619b730-4c9e-4101-8c9a-988f7b50f064-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-c55dc7b9-cf17-43be-816a-fd9a0b728e4e-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-c55dc7b9-cf17-43be-816a-fd9a0b728e4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-quobyte-c55dc7b9-cf17-43be-816a-fd9a0b728e4e" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-c55dc7b9-cf17-43be-816a-fd9a0b728e4e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Deleting offline snapshot c55dc7b9-cf17-43be-816a-fd9a0b728e4e of volume 63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] snapshot_file for this snap is: volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ef4352-1405-4ee3-ba50-6fca92acf7a5]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:57:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:08 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e Aug 26 18:57:08 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:09 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e" returned: 0 in 0.417s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d9edc5-6286-4e31-8271-bb0422ff87be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:57:09 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a477f98b-36f2-4f37-adb6-a860ef178942]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:57:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:09 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd Aug 26 18:57:09 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:09 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" returned: 0 in 0.413s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d9edc5-6286-4e31-8271-bb0422ff87be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:57:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:09 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e Aug 26 18:57:09 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:10 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e" returned: 0 in 0.468s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:10 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e Aug 26 18:57:10 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:10 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.c55dc7b9-cf17-43be-816a-fd9a0b728e4e" returned: 0 in 0.333s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-c55dc7b9-cf17-43be-816a-fd9a0b728e4e" released by "_delete_snapshot" :: held 1.744s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" released by "delete_snapshot" :: held 1.780s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:10 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Created reservations ['98438fa8-7578-4669-8378-fa234e584234', 'effb7e1f-e147-48a6-8745-cb73f0326c56', '99acb2ae-3eae-422e-993a-b42fe5e66f74', '982baab6-b5ae-4e13-8242-274952214346'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:57:10 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Delete snapshot completed successfully. Aug 26 18:57:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2dbe50f3-1224-4746-832a-c46d67fa1ea6 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-c55dc7b9-cf17-43be-816a-fd9a0b728e4e-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-b6638292-de5d-4d51-8ea7-96c2d1ee0dcd-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-b6638292-de5d-4d51-8ea7-96c2d1ee0dcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-quobyte-b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Deleting offline snapshot b6638292-de5d-4d51-8ea7-96c2d1ee0dcd of volume 63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] snapshot_file for this snap is: volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b99a99-8afe-484f-a7ec-cae1e9edcf11]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:11 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd Aug 26 18:57:11 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:11 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" returned: 0 in 0.397s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63d9edc5-6286-4e31-8271-bb0422ff87be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff6f63c-a1a8-4d5b-a949-b18663919e25]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:11 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be Aug 26 18:57:11 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:11 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be" returned: 0 in 0.436s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:12 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd Aug 26 18:57:12 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:12 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" returned: 0 in 0.430s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:12 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd Aug 26 18:57:12 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:12 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be.b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" returned: 0 in 0.318s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-b6638292-de5d-4d51-8ea7-96c2d1ee0dcd" released by "_delete_snapshot" :: held 1.750s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" released by "delete_snapshot" :: held 1.780s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:12 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Created reservations ['89743660-3647-4806-bb75-8aabcbaf3e87', '28adf13b-d920-4ad5-8031-4af08b737275', 'cddf1ead-1ed9-4016-9879-091b8e4e4f61', 'adc7d71a-30c8-4ad0-9043-6a1a7fc02fd0'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:57:12 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:57:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Flow 'volume_create_manager' (e946c251-f529-464a-a598-a1c08deb9295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:57:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6421cc21-cfec-4a68-9acb-8f9c85194333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6421cc21-cfec-4a68-9acb-8f9c85194333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2071185731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad850f2-5bdc-4c1f-881e-faa573c6dee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f9b3e22514600904c6d110a9b5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:57:13Z,use_quota=True,user_id='d4ddde0e83404ee58b66f01c685cb815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73aeb947-12fe-4ab3-9ed1-0a431f7692a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73aeb947-12fe-4ab3-9ed1-0a431f7692a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef96c088-7279-4c46-9650-5c0209481cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef96c088-7279-4c46-9650-5c0209481cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ad850f2-5bdc-4c1f-881e-faa573c6dee3', 'volume_name': 'volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1670152-6196-47b6-9de7-21143c2eb63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1670152-6196-47b6-9de7-21143c2eb63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72239260-de6a-4b77-a5e6-fc3d2fcf356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Volume 0ad850f2-5bdc-4c1f-881e-faa573c6dee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3', 'volume_size': 1} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2071185731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad850f2-5bdc-4c1f-881e-faa573c6dee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f9b3e22514600904c6d110a9b5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:57:13Z,use_quota=True,user_id='d4ddde0e83404ee58b66f01c685cb815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Creating volume 0ad850f2-5bdc-4c1f-881e-faa573c6dee3 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:57:13 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Delete snapshot completed successfully. Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e80d611-36de-4789-bb60-a6b4beb22d4c tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-b6638292-de5d-4d51-8ea7-96c2d1ee0dcd-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:13 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 1073741824 Aug 26 18:57:13 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-63d9edc5-6286-4e31-8271-bb0422ff87be-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-63d9edc5-6286-4e31-8271-bb0422ff87be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b09617a-09de-42a0-834d-7fcd66465c88]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:13 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be Aug 26 18:57:13 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:13 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 1073741824" returned: 0 in 0.498s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:13 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 Aug 26 18:57:13 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:13 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be" returned: 0 in 0.416s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:13 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be Aug 26 18:57:13 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:13 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3" returned: 0 in 0.283s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72239260-de6a-4b77-a5e6-fc3d2fcf356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8300cc1b-7532-4ecd-a1fc-fd9321715edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Volume volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 (0ad850f2-5bdc-4c1f-881e-faa573c6dee3): created successfully Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8300cc1b-7532-4ecd-a1fc-fd9321715edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Flow 'volume_create_manager' (e946c251-f529-464a-a598-a1c08deb9295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:57:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0479d4e5-e4c0-4136-b2ba-8e2315289397 tempest-AttachVolumeNegativeTest-2019027492 None] Created volume successfully. Aug 26 18:57:14 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-63d9edc5-6286-4e31-8271-bb0422ff87be" returned: 0 in 0.248s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-quobyte-63d9edc5-6286-4e31-8271-bb0422ff87be" released by "delete_volume" :: held 0.727s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Created reservations ['2962248b-0bf4-47cb-86ea-b350812740b9', 'eb8d55f4-37ea-4d21-8d44-c0ef8336451b', '2766fd8b-b64c-42b6-84d4-300cae949f07', 'fbf716fb-744c-4fc8-bcc5-5b562d344201'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:14 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:57:14 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:14 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.264s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:57:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Deleted volume successfully. Aug 26 18:57:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aabd284-d15d-4791-a9b3-7da294ce09c1 tempest-VolumesSnapshotListTestJSON-1730425860 None] Lock "cinder-63d9edc5-6286-4e31-8271-bb0422ff87be-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:57:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-7c502c88-9202-4c89-b4e5-4d36b3c50c1f req-e31b2eea-b9e3-44b8-8bfc-a1ae4fd68bdf tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-7c502c88-9202-4c89-b4e5-4d36b3c50c1f req-e31b2eea-b9e3-44b8-8bfc-a1ae4fd68bdf tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-7c502c88-9202-4c89-b4e5-4d36b3c50c1f req-e31b2eea-b9e3-44b8-8bfc-a1ae4fd68bdf tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-7c502c88-9202-4c89-b4e5-4d36b3c50c1f req-e31b2eea-b9e3-44b8-8bfc-a1ae4fd68bdf tempest-AttachVolumeNegativeTest-2019027492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a57e9ec0-e7a2-4112-8384-b50d179cde27', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:57:16 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-7c502c88-9202-4c89-b4e5-4d36b3c50c1f req-e31b2eea-b9e3-44b8-8bfc-a1ae4fd68bdf tempest-AttachVolumeNegativeTest-2019027492 None] attachment_update completed successfully. Aug 26 18:57:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-19f0f610-22b4-48db-925a-c85827459102 req-dd957c18-f7d0-40e5-95d7-9ff1cff67db8 tempest-AttachVolumeNegativeTest-2019027492 None] Terminate volume connection completed successfully. Aug 26 18:57:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-19f0f610-22b4-48db-925a-c85827459102 req-dd957c18-f7d0-40e5-95d7-9ff1cff67db8 tempest-AttachVolumeNegativeTest-2019027492 None] Deleting attachment a57e9ec0-e7a2-4112-8384-b50d179cde27. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:57:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-0c9762de-576d-4a41-a6dd-4d4406401b97 req-8d392c19-2d4f-4302-98a4-bd8e4ba1422d tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-0c9762de-576d-4a41-a6dd-4d4406401b97 req-8d392c19-2d4f-4302-98a4-bd8e4ba1422d tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-0c9762de-576d-4a41-a6dd-4d4406401b97 req-8d392c19-2d4f-4302-98a4-bd8e4ba1422d tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-0c9762de-576d-4a41-a6dd-4d4406401b97 req-8d392c19-2d4f-4302-98a4-bd8e4ba1422d tempest-ServerActionsTestOtherA-761705016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ebf057a-deb4-40d9-99df-15b3e37f2aed', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:57:24 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-0c9762de-576d-4a41-a6dd-4d4406401b97 req-8d392c19-2d4f-4302-98a4-bd8e4ba1422d tempest-ServerActionsTestOtherA-761705016 None] attachment_update completed successfully. Aug 26 18:57:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-40195dd2-0c52-47ff-a64a-1f68abc40146 req-3687bc2b-c735-454d-8322-9ee771ae8dac tempest-ServerActionsTestOtherA-761705016 None] Terminate volume connection completed successfully. Aug 26 18:57:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-40195dd2-0c52-47ff-a64a-1f68abc40146 req-3687bc2b-c735-454d-8322-9ee771ae8dac tempest-ServerActionsTestOtherA-761705016 None] Deleting attachment 1ebf057a-deb4-40d9-99df-15b3e37f2aed. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:57:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-40195dd2-0c52-47ff-a64a-1f68abc40146 req-8bd92d94-bb24-4cfd-aec3-5e491c7ed3cc tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-40195dd2-0c52-47ff-a64a-1f68abc40146 req-8bd92d94-bb24-4cfd-aec3-5e491c7ed3cc tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-40195dd2-0c52-47ff-a64a-1f68abc40146 req-8bd92d94-bb24-4cfd-aec3-5e491c7ed3cc tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-40195dd2-0c52-47ff-a64a-1f68abc40146 req-8bd92d94-bb24-4cfd-aec3-5e491c7ed3cc tempest-ServerActionsTestOtherA-761705016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1870eea-9b16-40e5-aab6-9e10cf0c60ba', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:57:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-40195dd2-0c52-47ff-a64a-1f68abc40146 req-8bd92d94-bb24-4cfd-aec3-5e491c7ed3cc tempest-ServerActionsTestOtherA-761705016 None] attachment_update completed successfully. Aug 26 18:57:41 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=51,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=4 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:57:41 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=37,cinder:SELECT=48,cinder:DELETE=1,cinder:INSERT=8 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Flow 'volume_create_manager' (ea3c81a0-5909-4d81-bc06-efe73b7ba956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7a9280-8be4-4dcf-8a95-0172a284e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7a9280-8be4-4dcf-8a95-0172a284e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-879349633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7869556-f659-4dcb-b263-071ec71f1d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01ecaf5c5664c23886df7bf1d4d104d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:57:51Z,use_quota=True,user_id='f41b9d2283c84769b247d19a67110bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7613ea6-7d08-4921-9411-628d615e3c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7613ea6-7d08-4921-9411-628d615e3c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3afb731-003d-471c-b84a-4ac72b8edf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3afb731-003d-471c-b84a-4ac72b8edf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7869556-f659-4dcb-b263-071ec71f1d36', 'volume_name': 'volume-e7869556-f659-4dcb-b263-071ec71f1d36', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144abacd-6735-4084-b833-09b53b295987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144abacd-6735-4084-b833-09b53b295987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcc3e68-24e3-4f09-9fb0-79cf4c9c17a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:50 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Volume e7869556-f659-4dcb-b263-071ec71f1d36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7869556-f659-4dcb-b263-071ec71f1d36', 'volume_size': 1} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-879349633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7869556-f659-4dcb-b263-071ec71f1d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01ecaf5c5664c23886df7bf1d4d104d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:57:51Z,use_quota=True,user_id='f41b9d2283c84769b247d19a67110bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Creating volume e7869556-f659-4dcb-b263-071ec71f1d36 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:57:50 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:57:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:50 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36 1073741824 Aug 26 18:57:50 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:51 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36 1073741824" returned: 0 in 0.936s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:51 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36 Aug 26 18:57:51 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:52 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:57:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcc3e68-24e3-4f09-9fb0-79cf4c9c17a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7869556-f659-4dcb-b263-071ec71f1d36', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72972ad4-4166-4380-bc49-c7b2dbb8e8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:52 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Volume volume-e7869556-f659-4dcb-b263-071ec71f1d36 (e7869556-f659-4dcb-b263-071ec71f1d36): created successfully Aug 26 18:57:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72972ad4-4166-4380-bc49-c7b2dbb8e8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Flow 'volume_create_manager' (ea3c81a0-5909-4d81-bc06-efe73b7ba956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:57:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ff5b9179-b751-47ec-ac09-e16c8c1ef71d tempest-AttachVolumeTestJSON-870733790 None] Created volume successfully. Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d2a685d6-69ed-44ad-82a9-0f7daf01e796 req-a935f2f2-93f6-4a6e-be8f-b0e3e10a4fd0 tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d2a685d6-69ed-44ad-82a9-0f7daf01e796 req-a935f2f2-93f6-4a6e-be8f-b0e3e10a4fd0 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d2a685d6-69ed-44ad-82a9-0f7daf01e796 req-a935f2f2-93f6-4a6e-be8f-b0e3e10a4fd0 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-d2a685d6-69ed-44ad-82a9-0f7daf01e796 req-a935f2f2-93f6-4a6e-be8f-b0e3e10a4fd0 tempest-AttachVolumeTestJSON-870733790 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-e7869556-f659-4dcb-b263-071ec71f1d36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd11d479c-514e-466e-ab20-c79577e880eb', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:57:54 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-d2a685d6-69ed-44ad-82a9-0f7daf01e796 req-a935f2f2-93f6-4a6e-be8f-b0e3e10a4fd0 tempest-AttachVolumeTestJSON-870733790 None] attachment_update completed successfully. Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:54 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:57:54 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:55 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.692s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:57:55 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:57:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 8 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:57:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Flow 'volume_create_manager' (4923d56a-df4c-456e-9486-dca7f5c9601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4afd9c4-cef0-427b-adaa-de11815a5b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4afd9c4-cef0-427b-adaa-de11815a5b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-754480714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6943b6b-cae8-422c-b03d-536e1dc38427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01ecaf5c5664c23886df7bf1d4d104d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:57:57Z,use_quota=True,user_id='f41b9d2283c84769b247d19a67110bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02faee61-301f-4738-af20-51647111c181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02faee61-301f-4738-af20-51647111c181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fddc01-1f4b-497c-9a5b-60b89692a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fddc01-1f4b-497c-9a5b-60b89692a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6943b6b-cae8-422c-b03d-536e1dc38427', 'volume_name': 'volume-a6943b6b-cae8-422c-b03d-536e1dc38427', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf0f728-604d-49b2-91ad-d6362d570470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf0f728-604d-49b2-91ad-d6362d570470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d96575-d79c-41a5-bf3c-4f6f92ae8218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:57 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Volume a6943b6b-cae8-422c-b03d-536e1dc38427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6943b6b-cae8-422c-b03d-536e1dc38427', 'volume_size': 1} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-754480714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6943b6b-cae8-422c-b03d-536e1dc38427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01ecaf5c5664c23886df7bf1d4d104d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:57:57Z,use_quota=True,user_id='f41b9d2283c84769b247d19a67110bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Creating volume a6943b6b-cae8-422c-b03d-536e1dc38427 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:57:57 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:57:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:57 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427 1073741824 Aug 26 18:57:57 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:58 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427 1073741824" returned: 0 in 1.127s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:57:59 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427 Aug 26 18:57:59 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:57:59 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Aug 26 18:57:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427" returned: 0 in 0.687s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:57:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:57:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:57:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d96575-d79c-41a5-bf3c-4f6f92ae8218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6943b6b-cae8-422c-b03d-536e1dc38427', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdff05cb-b27c-4825-8cce-7ab34e93859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:57:59 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Volume volume-a6943b6b-cae8-422c-b03d-536e1dc38427 (a6943b6b-cae8-422c-b03d-536e1dc38427): created successfully Aug 26 18:57:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdff05cb-b27c-4825-8cce-7ab34e93859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:57:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Flow 'volume_create_manager' (4923d56a-df4c-456e-9486-dca7f5c9601e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:57:59 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a97abb81-6c20-48af-b09d-1200f29df197 tempest-AttachVolumeTestJSON-870733790 None] Created volume successfully. Aug 26 18:58:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-6f7e302a-6614-4048-b2c8-41dd281a5629 req-c639021e-be0b-46d7-bfd2-7ceecb5d17d0 tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-6f7e302a-6614-4048-b2c8-41dd281a5629 req-c639021e-be0b-46d7-bfd2-7ceecb5d17d0 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-6f7e302a-6614-4048-b2c8-41dd281a5629 req-c639021e-be0b-46d7-bfd2-7ceecb5d17d0 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-6f7e302a-6614-4048-b2c8-41dd281a5629 req-c639021e-be0b-46d7-bfd2-7ceecb5d17d0 tempest-AttachVolumeTestJSON-870733790 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-a6943b6b-cae8-422c-b03d-536e1dc38427', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af10d709-3bc0-4dd1-ae01-c60506d6bc07', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:58:01 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-6f7e302a-6614-4048-b2c8-41dd281a5629 req-c639021e-be0b-46d7-bfd2-7ceecb5d17d0 tempest-AttachVolumeTestJSON-870733790 None] attachment_update completed successfully. Aug 26 18:58:04 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-dea7aa3a-6c08-4bb4-b389-c14c4b09d0fa req-ebc8689d-9e99-4142-b242-f4373f7d0537 tempest-ServerActionsTestOtherA-761705016 None] Terminate volume connection completed successfully. Aug 26 18:58:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-dea7aa3a-6c08-4bb4-b389-c14c4b09d0fa req-ebc8689d-9e99-4142-b242-f4373f7d0537 tempest-ServerActionsTestOtherA-761705016 None] Deleting attachment d1870eea-9b16-40e5-aab6-9e10cf0c60ba. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:58:05 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-99556459-3627-4cf7-acca-2a205bba4238 req-87eb0ed2-21d2-438a-af93-e87661c0c200 tempest-AttachVolumeTestJSON-870733790 None] Terminate volume connection completed successfully. Aug 26 18:58:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-99556459-3627-4cf7-acca-2a205bba4238 req-87eb0ed2-21d2-438a-af93-e87661c0c200 tempest-AttachVolumeTestJSON-870733790 None] Deleting attachment d11d479c-514e-466e-ab20-c79577e880eb. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:58:07 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-bec175e3-7d91-4b04-abe2-0096dd32dd56 req-e97ba7ee-fc74-4a5b-8fbd-da9ee67d945d tempest-AttachVolumeTestJSON-870733790 None] Terminate volume connection completed successfully. Aug 26 18:58:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-bec175e3-7d91-4b04-abe2-0096dd32dd56 req-e97ba7ee-fc74-4a5b-8fbd-da9ee67d945d tempest-AttachVolumeTestJSON-870733790 None] Deleting attachment af10d709-3bc0-4dd1-ae01-c60506d6bc07. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Flow 'volume_create_manager' (8a6de4c9-8bc8-403c-bd71-e67204fe0e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1abb5e-9c48-4013-bcb3-33c66efd940d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1abb5e-9c48-4013-bcb3-33c66efd940d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-126965107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4f8b1e-35dc-418d-973c-7216c02677e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f9b3e22514600904c6d110a9b5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:58:14Z,use_quota=True,user_id='d4ddde0e83404ee58b66f01c685cb815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d26eb6b-31c3-4b57-9241-b95f87328296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d26eb6b-31c3-4b57-9241-b95f87328296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8854db18-4f5c-401a-8745-627ef93cdd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8854db18-4f5c-401a-8745-627ef93cdd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4f8b1e-35dc-418d-973c-7216c02677e5', 'volume_name': 'volume-be4f8b1e-35dc-418d-973c-7216c02677e5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e1b47d-a125-4341-8e81-14b5078302b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e1b47d-a125-4341-8e81-14b5078302b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e65115c-b79a-4eb2-a023-7459fe3e2a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Volume be4f8b1e-35dc-418d-973c-7216c02677e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4f8b1e-35dc-418d-973c-7216c02677e5', 'volume_size': 1} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-126965107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4f8b1e-35dc-418d-973c-7216c02677e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f9b3e22514600904c6d110a9b5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:58:14Z,use_quota=True,user_id='d4ddde0e83404ee58b66f01c685cb815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Creating volume be4f8b1e-35dc-418d-973c-7216c02677e5 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:58:13 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:58:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:14 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5 1073741824 Aug 26 18:58:14 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:14 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5 1073741824" returned: 0 in 0.788s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:14 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5 Aug 26 18:58:14 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:15 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5" returned: 0 in 0.321s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e65115c-b79a-4eb2-a023-7459fe3e2a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4f8b1e-35dc-418d-973c-7216c02677e5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72cdb10-8ddd-4be2-bdad-986b6a20054a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:15 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Volume volume-be4f8b1e-35dc-418d-973c-7216c02677e5 (be4f8b1e-35dc-418d-973c-7216c02677e5): created successfully Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72cdb10-8ddd-4be2-bdad-986b6a20054a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Flow 'volume_create_manager' (8a6de4c9-8bc8-403c-bd71-e67204fe0e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:58:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-6a5ab422-fd62-4b9e-ae6a-3652cb31aa7d tempest-AttachVolumeNegativeTest-2019027492 None] Created volume successfully. Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "cinder-a6943b6b-cae8-422c-b03d-536e1dc38427-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-a6943b6b-cae8-422c-b03d-536e1dc38427-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "cinder-quobyte-a6943b6b-cae8-422c-b03d-536e1dc38427" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-quobyte-a6943b6b-cae8-422c-b03d-536e1dc38427" acquired by "delete_volume" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5a8d75-70b0-4304-931c-0e65b4132a79]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Flow 'volume_create_manager' (e0b39192-d9de-4a11-be1e-1d3c3e59a165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c35da0-89a0-439e-9348-67eed5a1f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c35da0-89a0-439e-9348-67eed5a1f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-603788015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749b38f4-4bc8-44b2-a033-110aed0de8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f09497d70d429cb05bd13adce86acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:58:16Z,use_quota=True,user_id='b397a9750e6149929ae884ca5ca71041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8739e5b5-801f-47db-86dd-8f5722927220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8739e5b5-801f-47db-86dd-8f5722927220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901015ec-9519-443c-a17c-06da4f117f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901015ec-9519-443c-a17c-06da4f117f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '749b38f4-4bc8-44b2-a033-110aed0de8f4', 'volume_name': 'volume-749b38f4-4bc8-44b2-a033-110aed0de8f4', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b4c7eb-2da0-454f-9cba-403dd5eeb1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b4c7eb-2da0-454f-9cba-403dd5eeb1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf92bb2-0094-49d7-b284-66081268fc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:15 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Volume 749b38f4-4bc8-44b2-a033-110aed0de8f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-749b38f4-4bc8-44b2-a033-110aed0de8f4', 'volume_size': 1} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-603788015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749b38f4-4bc8-44b2-a033-110aed0de8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f09497d70d429cb05bd13adce86acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:58:16Z,use_quota=True,user_id='b397a9750e6149929ae884ca5ca71041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Creating volume 749b38f4-4bc8-44b2-a033-110aed0de8f4 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:58:16 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:16 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427 Aug 26 18:58:16 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:16 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 1073741824 Aug 26 18:58:16 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:16 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427" returned: 0 in 0.525s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:16 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427 Aug 26 18:58:16 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:16 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a6943b6b-cae8-422c-b03d-536e1dc38427" returned: 0 in 0.422s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-quobyte-a6943b6b-cae8-422c-b03d-536e1dc38427" released by "delete_volume" :: held 1.057s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:16 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 1073741824" returned: 0 in 0.900s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:16 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Flow 'volume_create_manager' (7cc8e016-5ac0-47ac-bb62-5369f3c45c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d0fb6e-7ad4-45d2-9b02-413f2c8573c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Created reservations ['a8f4cf18-5a87-4ea1-b8f6-826bf8d31de0', '600b5376-125a-401d-9d27-003dbe99190e', '6ceb7631-0bae-43af-b198-edb3a86d7bf9', 'b7688483-35a7-48ca-8a19-3ce7701d0175'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d0fb6e-7ad4-45d2-9b02-413f2c8573c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-925530110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b734a9-dab5-4836-afbc-c3a40ffa708d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d419c0c0bb404607ad4a484390cab93a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:58:17Z,use_quota=True,user_id='1ee6b0fa6e7d46a3bbafa835b9eaf38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18e9b95-386d-4e6d-ae0a-47cf4c155013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18e9b95-386d-4e6d-ae0a-47cf4c155013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b531c16-78c7-4b2e-9f16-c1f287fec937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-da16f4df-7c18-44ad-beb2-33180fd266b2 req-c0c4d45d-3d86-4a77-825d-b1597c96737c tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:17 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 Aug 26 18:58:17 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:17 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:58:17 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:17 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4" returned: 0 in 0.339s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-da16f4df-7c18-44ad-beb2-33180fd266b2 req-c0c4d45d-3d86-4a77-825d-b1597c96737c tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.325s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf92bb2-0094-49d7-b284-66081268fc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-749b38f4-4bc8-44b2-a033-110aed0de8f4', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c176e029-eef5-4b44-ac29-6647e6edf9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-da16f4df-7c18-44ad-beb2-33180fd266b2 req-c0c4d45d-3d86-4a77-825d-b1597c96737c tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:17 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Volume volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 (749b38f4-4bc8-44b2-a033-110aed0de8f4): created successfully Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c176e029-eef5-4b44-ac29-6647e6edf9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Flow 'volume_create_manager' (e0b39192-d9de-4a11-be1e-1d3c3e59a165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:58:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-fb809720-3448-4f5c-98b0-52567b984c91 tempest-TestMinimumBasicScenario-736670518 None] Created volume successfully. Aug 26 18:58:17 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.360s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-da16f4df-7c18-44ad-beb2-33180fd266b2 req-c0c4d45d-3d86-4a77-825d-b1597c96737c tempest-AttachVolumeNegativeTest-2019027492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-be4f8b1e-35dc-418d-973c-7216c02677e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '310fa8ee-4a94-4682-9ad2-0f14845f79d7', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:58:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Deleted volume successfully. Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a6e9f9f0-99ee-4308-b9c2-b017e397009a tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-a6943b6b-cae8-422c-b03d-536e1dc38427-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b531c16-78c7-4b2e-9f16-c1f287fec937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83b734a9-dab5-4836-afbc-c3a40ffa708d', 'volume_name': 'volume-83b734a9-dab5-4836-afbc-c3a40ffa708d', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f50dda-3e2b-4c12-9e34-4e960851f91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f50dda-3e2b-4c12-9e34-4e960851f91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16066164-161b-43a4-b63b-91cc565cdf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:17 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Volume 83b734a9-dab5-4836-afbc-c3a40ffa708d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83b734a9-dab5-4836-afbc-c3a40ffa708d', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 18:58:17 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Trying to clone 83b734a9-dab5-4836-afbc-c3a40ffa708d from image a20b2d73-0a49-4820-9be0-26e70205cff9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 18:58:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-da16f4df-7c18-44ad-beb2-33180fd266b2 req-c0c4d45d-3d86-4a77-825d-b1597c96737c tempest-AttachVolumeNegativeTest-2019027492 None] attachment_update completed successfully. Aug 26 18:58:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "cinder-e7869556-f659-4dcb-b263-071ec71f1d36-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-e7869556-f659-4dcb-b263-071ec71f1d36-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:18 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 18:58:18 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Image download 20.69 MB at 20.69 MB/s Aug 26 18:58:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "cinder-quobyte-e7869556-f659-4dcb-b263-071ec71f1d36" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:18 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa1d5b-56ef-4076-80db-fd83e422a669]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-quobyte-e7869556-f659-4dcb-b263-071ec71f1d36" acquired by "delete_volume" :: waited 0.044s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:18 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1f7849-9efa-4ba9-9b62-fc488c52ed55]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:18 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD Aug 26 18:58:18 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:18 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36 Aug 26 18:58:18 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:19 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36" returned: 0 in 0.625s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:19 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36 Aug 26 18:58:19 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:19 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD" returned: 0 in 0.764s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 is fetched for user 1ee6b0fa6e7d46a3bbafa835b9eaf38d. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bd2a94-9f06-4ea4-9945-5f2f6ee32364]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:19 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e7869556-f659-4dcb-b263-071ec71f1d36" returned: 0 in 0.417s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-quobyte-e7869556-f659-4dcb-b263-071ec71f1d36" released by "delete_volume" :: held 1.111s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:19 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD Aug 26 18:58:19 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Created reservations ['40c5b202-02dd-43bc-9f6c-a13f3976ff37', 'fbea0973-0975-4943-8526-b264d37f2076', 'eb108bad-ce66-45c7-adc5-628077aa600b', 'deae66e3-454f-4dd3-aefc-f86792396d92'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-ec8134a9-722a-4272-b6c0-b2a1618bac05 req-803d5a70-cf2c-47c1-90d5-bc77b529602e tempest-TestMinimumBasicScenario-736670518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-ec8134a9-722a-4272-b6c0-b2a1618bac05 req-803d5a70-cf2c-47c1-90d5-bc77b529602e tempest-TestMinimumBasicScenario-736670518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-ec8134a9-722a-4272-b6c0-b2a1618bac05 req-803d5a70-cf2c-47c1-90d5-bc77b529602e tempest-TestMinimumBasicScenario-736670518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ec8134a9-722a-4272-b6c0-b2a1618bac05 req-803d5a70-cf2c-47c1-90d5-bc77b529602e tempest-TestMinimumBasicScenario-736670518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-749b38f4-4bc8-44b2-a033-110aed0de8f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6817813c-0368-4584-9e11-9a04abdc93b4', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:58:19 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:58:19 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:19 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD" returned: 0 in 0.516s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-925530110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b734a9-dab5-4836-afbc-c3a40ffa708d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d419c0c0bb404607ad4a484390cab93a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:58:17Z,use_quota=True,user_id='1ee6b0fa6e7d46a3bbafa835b9eaf38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Creating volume 83b734a9-dab5-4836-afbc-c3a40ffa708d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:58:19 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:58:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:19 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d 1073741824 Aug 26 18:58:19 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-ec8134a9-722a-4272-b6c0-b2a1618bac05 req-803d5a70-cf2c-47c1-90d5-bc77b529602e tempest-TestMinimumBasicScenario-736670518 None] attachment_update completed successfully. Aug 26 18:58:20 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.398s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:58:20 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Deleted volume successfully. Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c71c9f17-c3c3-4bb6-a9e5-5253608a04be tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-e7869556-f659-4dcb-b263-071ec71f1d36-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:20 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d 1073741824" returned: 0 in 0.696s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:20 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d Aug 26 18:58:20 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "cinder-2d220e27-ad48-4222-a58a-273790312312-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-2d220e27-ad48-4222-a58a-273790312312-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "cinder-quobyte-2d220e27-ad48-4222-a58a-273790312312" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-quobyte-2d220e27-ad48-4222-a58a-273790312312" acquired by "delete_volume" :: waited 0.030s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d85758-e9c1-4dde-8c4f-2715f854292b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:21 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312 Aug 26 18:58:21 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:21 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d" returned: 0 in 0.577s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Attempting download of a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume 83b734a9-dab5-4836-afbc-c3a40ffa708d. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[90758c23-a697-46b9-8efd-252179d46855]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_su869oo8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:21 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312" returned: 0 in 0.540s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:21 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_su869oo8 Aug 26 18:58:21 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:21 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312 Aug 26 18:58:21 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-79e1a5b2-838b-49b3-b32d-bc3c9650c7ae req-ca981b4a-e3b2-4753-837f-ce7e4ead846d tempest-AttachVolumeNegativeTest-2019027492 None] Terminate volume connection completed successfully. Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-79e1a5b2-838b-49b3-b32d-bc3c9650c7ae req-ca981b4a-e3b2-4753-837f-ce7e4ead846d tempest-AttachVolumeNegativeTest-2019027492 None] Deleting attachment 310fa8ee-4a94-4682-9ad2-0f14845f79d7. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:58:21 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2d220e27-ad48-4222-a58a-273790312312" returned: 0 in 0.330s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-quobyte-2d220e27-ad48-4222-a58a-273790312312" released by "delete_volume" :: held 0.953s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:21 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_su869oo8" returned: 0 in 0.623s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_su869oo8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Created reservations ['adb35b31-8a5e-45de-a191-c54b880bca0e', 'a4c20150-0e50-4053-88df-51ed4197d6a4', '63c52239-4238-4626-9433-f0ca093369ca', '4cff8150-0d54-4f95-9864-c39cbabe6f98'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:22 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_su869oo8 Aug 26 18:58:22 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:22 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:58:22 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:22 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_su869oo8" returned: 1 in 0.533s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_su869oo8' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdee9c6-7d93-4988-ad77-296494a097b1]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:22 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.326s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:58:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Deleted volume successfully. Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31b1d9ff-560f-43c8-a286-31591fa83241 tempest-AttachVolumeTestJSON-870733790 None] Lock "cinder-2d220e27-ad48-4222-a58a-273790312312-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:22 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD Aug 26 18:58:22 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:22 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] a20b2d73-0a49-4820-9be0-26e70205cff9 was qcow2, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 18:58:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:22 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d Aug 26 18:58:22 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:25 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d" returned: 0 in 2.926s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:25 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_5ttlesn4devstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 18:58:25 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Converted 112.00 MB image at 38.25 MB/s Aug 26 18:58:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:25 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d 1G Aug 26 18:58:25 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:26 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d 1G" returned: 0 in 0.390s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Downloaded image a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume 83b734a9-dab5-4836-afbc-c3a40ffa708d successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 for user 1ee6b0fa6e7d46a3bbafa835b9eaf38d is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Marking volume 83b734a9-dab5-4836-afbc-c3a40ffa708d as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Copying metadata from image a20b2d73-0a49-4820-9be0-26e70205cff9 to 83b734a9-dab5-4836-afbc-c3a40ffa708d. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Creating volume glance metadata for volume 83b734a9-dab5-4836-afbc-c3a40ffa708d backed by image a20b2d73-0a49-4820-9be0-26e70205cff9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16066164-161b-43a4-b63b-91cc565cdf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b734a9-dab5-4836-afbc-c3a40ffa708d', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a7a461-7be6-4ba7-a175-2654db1c9a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:26 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Volume volume-83b734a9-dab5-4836-afbc-c3a40ffa708d (83b734a9-dab5-4836-afbc-c3a40ffa708d): created successfully Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a7a461-7be6-4ba7-a175-2654db1c9a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Flow 'volume_create_manager' (7cc8e016-5ac0-47ac-bb62-5369f3c45c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:58:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f0329a8f-61a5-4d26-bbd7-135dff8749f5 tempest-ServerActionsTestOtherA-761705016 None] Created volume successfully. Aug 26 18:58:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "cinder-be4f8b1e-35dc-418d-973c-7216c02677e5-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-be4f8b1e-35dc-418d-973c-7216c02677e5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "cinder-quobyte-be4f8b1e-35dc-418d-973c-7216c02677e5" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-quobyte-be4f8b1e-35dc-418d-973c-7216c02677e5" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:31 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc468248-be22-4810-9b6a-c237999b8581]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:31 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5 Aug 26 18:58:31 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:31 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5" returned: 0 in 0.627s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:31 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5 Aug 26 18:58:31 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:32 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-be4f8b1e-35dc-418d-973c-7216c02677e5" returned: 0 in 0.532s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-quobyte-be4f8b1e-35dc-418d-973c-7216c02677e5" released by "delete_volume" :: held 1.238s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Created reservations ['a1520564-0f1d-452d-a4e2-2d7c4baaef9d', '429baff2-9540-4cce-9563-ecf5e2d3ecc1', '9dd2f79f-edee-47a4-bd96-dedb98bd7146', '8a92e28b-05f7-48f0-81bf-8ca5c1f349df'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d549670b-7a5a-47c2-babd-7d636a466498 req-d6872f9f-c1a6-4c5c-b46a-dd859bfc2716 tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d549670b-7a5a-47c2-babd-7d636a466498 req-d6872f9f-c1a6-4c5c-b46a-dd859bfc2716 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d549670b-7a5a-47c2-babd-7d636a466498 req-d6872f9f-c1a6-4c5c-b46a-dd859bfc2716 tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-d549670b-7a5a-47c2-babd-7d636a466498 req-d6872f9f-c1a6-4c5c-b46a-dd859bfc2716 tempest-ServerActionsTestOtherA-761705016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-83b734a9-dab5-4836-afbc-c3a40ffa708d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '607b5412-4c97-4fc7-822c-77df7baddd21', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:58:32 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:58:32 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-d549670b-7a5a-47c2-babd-7d636a466498 req-d6872f9f-c1a6-4c5c-b46a-dd859bfc2716 tempest-ServerActionsTestOtherA-761705016 None] attachment_update completed successfully. Aug 26 18:58:33 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.535s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:33 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:58:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Deleted volume successfully. Aug 26 18:58:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f6640066-c50f-42ca-813c-ccf548c53971 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-be4f8b1e-35dc-418d-973c-7216c02677e5-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "cinder-0ad850f2-5bdc-4c1f-881e-faa573c6dee3-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-0ad850f2-5bdc-4c1f-881e-faa573c6dee3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "cinder-quobyte-0ad850f2-5bdc-4c1f-881e-faa573c6dee3" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-quobyte-0ad850f2-5bdc-4c1f-881e-faa573c6dee3" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[65644b8b-1b4c-40dd-bb7a-d9d2597a0b13]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:34 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 Aug 26 18:58:34 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:34 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3" returned: 0 in 0.570s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:34 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3 Aug 26 18:58:34 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:34 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0ad850f2-5bdc-4c1f-881e-faa573c6dee3" returned: 0 in 0.351s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-quobyte-0ad850f2-5bdc-4c1f-881e-faa573c6dee3" released by "delete_volume" :: held 0.982s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Created reservations ['86188cb5-c790-4461-83e2-30ce96314da8', 'cbacf8a3-4703-49c0-aed7-37db3ef9579c', '7fecd3cc-7333-4d06-94f9-d356f138ed11', '60d978b7-e2dc-441e-9233-3521a32f44bf'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:34 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:58:34 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:35 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.279s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:58:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Deleted volume successfully. Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e0e7e682-2de6-4e3d-a4e4-946d95958a26 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-0ad850f2-5bdc-4c1f-881e-faa573c6dee3-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Flow 'volume_create_manager' (12eacddb-4198-408c-856f-89574dac78c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ef072a-8647-4185-8f94-6fca9a8da81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ef072a-8647-4185-8f94-6fca9a8da81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-820246152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971f616e-a761-4d2f-82f6-2df9712e6c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9492417bc43c4811923f209501d7b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:58:36Z,use_quota=True,user_id='3114a27e59df4b98af514847d03e77d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbad0ea-51b2-467d-bcbe-b0b397f00760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbad0ea-51b2-467d-bcbe-b0b397f00760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7fea84-9562-4964-a498-9b396617ebed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7fea84-9562-4964-a498-9b396617ebed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '971f616e-a761-4d2f-82f6-2df9712e6c81', 'volume_name': 'volume-971f616e-a761-4d2f-82f6-2df9712e6c81', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a067f61-5a1a-41aa-9d2c-7dcd18b9b142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a067f61-5a1a-41aa-9d2c-7dcd18b9b142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5f2016-3186-4621-a5d4-3b2f1c6a4cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:35 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Volume 971f616e-a761-4d2f-82f6-2df9712e6c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-971f616e-a761-4d2f-82f6-2df9712e6c81', 'volume_size': 1} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-820246152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971f616e-a761-4d2f-82f6-2df9712e6c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9492417bc43c4811923f209501d7b243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:58:36Z,use_quota=True,user_id='3114a27e59df4b98af514847d03e77d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Creating volume 971f616e-a761-4d2f-82f6-2df9712e6c81 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:58:35 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:58:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:35 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 1073741824 Aug 26 18:58:35 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "cinder-a98607ef-610d-4c3d-986c-e088e2a3a6f6-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-a98607ef-610d-4c3d-986c-e088e2a3a6f6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "cinder-quobyte-a98607ef-610d-4c3d-986c-e088e2a3a6f6" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:36 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 1073741824" returned: 0 in 0.994s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-quobyte-a98607ef-610d-4c3d-986c-e088e2a3a6f6" acquired by "delete_volume" :: waited 0.058s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:36 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f11438c-b808-44b7-9861-12eb3cd032b8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:36 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 Aug 26 18:58:36 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:37 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 Aug 26 18:58:37 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:37 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81" returned: 0 in 0.330s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5f2016-3186-4621-a5d4-3b2f1c6a4cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971f616e-a761-4d2f-82f6-2df9712e6c81', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df31bbb4-11eb-45fc-b7fe-94d9fbb1e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:58:37 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Volume volume-971f616e-a761-4d2f-82f6-2df9712e6c81 (971f616e-a761-4d2f-82f6-2df9712e6c81): created successfully Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df31bbb4-11eb-45fc-b7fe-94d9fbb1e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Flow 'volume_create_manager' (12eacddb-4198-408c-856f-89574dac78c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:58:37 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-ea3b00e0-a336-4942-af43-2153bb577f59 req-8465d2a9-c32f-4687-b29c-49c111672905 tempest-VolumesSnapshotsTestJSON-921246163 None] Created volume successfully. Aug 26 18:58:37 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6" returned: 0 in 0.803s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:37 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6 Aug 26 18:58:37 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:37 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a98607ef-610d-4c3d-986c-e088e2a3a6f6" returned: 0 in 0.311s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-quobyte-a98607ef-610d-4c3d-986c-e088e2a3a6f6" released by "delete_volume" :: held 1.183s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Created reservations ['00dd2ac6-29ca-4ca9-b409-67ece8b08346', '42b1777f-982c-4dc9-ac9b-f9e29bfbf5ac', 'e1cf3780-0d8c-45b2-b8fe-a99681b82f9c', '0d787387-cbb4-40ca-80bc-97a2d5936ef1'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:38 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:58:38 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Creating offline snapshot 40c14558-6de2-48ec-8324-f3437236e99e of volume 971f616e-a761-4d2f-82f6-2df9712e6c81 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e8281-49bc-4f48-900c-753e49f1dcdb]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:38 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.302s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:58:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Deleted volume successfully. Aug 26 18:58:38 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 Aug 26 18:58:38 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8c1b3b2f-0e6c-4db1-a16e-51860f6987c1 tempest-AttachVolumeNegativeTest-2019027492 None] Lock "cinder-a98607ef-610d-4c3d-986c-e088e2a3a6f6-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:38 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81" returned: 0 in 0.452s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:38 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e 1G Aug 26 18:58:38 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:39 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e 1G" returned: 0 in 0.629s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-971f616e-a761-4d2f-82f6-2df9712e6c81 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:39 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-971f616e-a761-4d2f-82f6-2df9712e6c81 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e Aug 26 18:58:39 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:39 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-971f616e-a761-4d2f-82f6-2df9712e6c81 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e" returned: 0 in 0.431s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:39 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e is being set with open permissions: ugo+rw Aug 26 18:58:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:39 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e Aug 26 18:58:39 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:40 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e" returned: 0 in 0.313s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:40 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.info Aug 26 18:58:40 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:40 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.info" returned: 0 in 0.489s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:40 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.info is being set with open permissions: ugo+rw Aug 26 18:58:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:40 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.info Aug 26 18:58:40 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:41 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.info" returned: 0 in 0.413s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-f9d92534-06c9-42a6-8313-20ee1f199439 req-e8f15067-956d-44b9-9bf7-a0cde400c02a tempest-VolumesSnapshotsTestJSON-921246163 None] Create snapshot completed successfully Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Acquiring lock "cinder-40c14558-6de2-48ec-8324-f3437236e99e-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-40c14558-6de2-48ec-8324-f3437236e99e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Acquiring lock "cinder-quobyte-971f616e-a761-4d2f-82f6-2df9712e6c81" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-quobyte-971f616e-a761-4d2f-82f6-2df9712e6c81" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Acquiring lock "cinder-quobyte-40c14558-6de2-48ec-8324-f3437236e99e" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-quobyte-40c14558-6de2-48ec-8324-f3437236e99e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Deleting offline snapshot 40c14558-6de2-48ec-8324-f3437236e99e of volume 971f616e-a761-4d2f-82f6-2df9712e6c81 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] snapshot_file for this snap is: volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d39675-cd5d-4c79-aec0-e19ead762131]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:42 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e Aug 26 18:58:42 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:42 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e" returned: 0 in 0.755s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-971f616e-a761-4d2f-82f6-2df9712e6c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:58:43 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f11e09-ac18-4347-9f64-2f41b7ed84b5]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:43 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 Aug 26 18:58:43 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:43 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81" returned: 0 in 0.563s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:43 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e Aug 26 18:58:43 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:44 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e" returned: 0 in 0.948s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:44 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e Aug 26 18:58:44 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:45 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81.40c14558-6de2-48ec-8324-f3437236e99e" returned: 0 in 0.616s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:45 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=91,cinder:INSERT=23,cinder:UPDATE=72,cinder:DELETE=5 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:58:45 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=82,cinder:SELECT=91,cinder:DELETE=8,cinder:INSERT=21 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:58:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-quobyte-40c14558-6de2-48ec-8324-f3437236e99e" released by "_delete_snapshot" :: held 3.196s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-quobyte-971f616e-a761-4d2f-82f6-2df9712e6c81" released by "delete_snapshot" :: held 3.264s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:45 devstack cinder-volume[93671]: DEBUG cinder.quota [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Created reservations ['87bc8cad-17d9-4846-80d9-a43d6a8530bf', '4c6d02ad-f43b-41a1-952a-aab1b3eaca7f', '946873bf-18c1-4d61-a5ed-91079dfc93b6', 'b968f0ed-b54f-4802-89e5-06c9881153cd'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:58:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Delete snapshot completed successfully. Aug 26 18:58:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-d8f5353b-c0cb-4f70-947b-275bef29e295 req-48c7fd29-f84e-475f-8a2e-f9565ec664e2 tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-40c14558-6de2-48ec-8324-f3437236e99e-delete_snapshot" released by "delete_snapshot" :: held 3.690s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Acquiring lock "cinder-971f616e-a761-4d2f-82f6-2df9712e6c81-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-971f616e-a761-4d2f-82f6-2df9712e6c81-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Acquiring lock "cinder-quobyte-971f616e-a761-4d2f-82f6-2df9712e6c81" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:58:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-quobyte-971f616e-a761-4d2f-82f6-2df9712e6c81" acquired by "delete_volume" :: waited 0.052s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:58:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e5e0eb-11b2-4a7d-951a-59991eede477]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:58:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:47 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 Aug 26 18:58:47 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:47 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81" returned: 0 in 0.702s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:47 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81 Aug 26 18:58:47 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:48 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-971f616e-a761-4d2f-82f6-2df9712e6c81" returned: 0 in 0.532s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-quobyte-971f616e-a761-4d2f-82f6-2df9712e6c81" released by "delete_volume" :: held 1.364s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG cinder.quota [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Created reservations ['26846b4f-968c-4184-adfc-9f1602eebfcf', '9287e67f-0b33-4fcc-9aa4-2538e683f997', '64f1477c-52f1-49a1-adee-00a30383a736', '76fe2356-3e11-4bf8-9cfe-2e70bb6a4d39'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:48 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:58:48 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:48 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.415s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG cinder.manager [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:58:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Deleted volume successfully. Aug 26 18:58:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-f2c0fa64-725f-477a-a500-d3d17a5dfee0 req-cbf649aa-e14c-4d3c-847a-bfc327c72eba tempest-VolumesSnapshotsTestJSON-921246163 None] Lock "cinder-971f616e-a761-4d2f-82f6-2df9712e6c81-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:58:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-655d9fd8-3df1-4570-b76e-95ede670d8c4 req-4a785b56-2ba2-411a-ad8a-caa76518962e tempest-ServerActionsTestOtherA-761705016 None] Terminate volume connection completed successfully. Aug 26 18:58:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-655d9fd8-3df1-4570-b76e-95ede670d8c4 req-4a785b56-2ba2-411a-ad8a-caa76518962e tempest-ServerActionsTestOtherA-761705016 None] Deleting attachment 607b5412-4c97-4fc7-822c-77df7baddd21. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:58:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:58:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:58:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:58:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:58:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-167c3fec-95d3-480e-bc49-a0a0847473f1 tempest-BackendsCapabilitiesAdminTestsJSON-208630545 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.7907447814941, 'free_capacity_gb': 1774.7907447814941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93671) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 18:58:54 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:58:54 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:58:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c7afbce8-cca0-42de-97ac-11b49afea82b tempest-BackendsCapabilitiesAdminTestsJSON-208630545 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.7907447814941, 'free_capacity_gb': 1774.7907447814941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93671) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 18:58:55 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Aug 26 18:58:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.521s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:58:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:58:55 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:58:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:58:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:58:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-655d9fd8-3df1-4570-b76e-95ede670d8c4 req-f6adadaa-c3e5-46af-940c-0214a84f8a3c tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:58:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-655d9fd8-3df1-4570-b76e-95ede670d8c4 req-f6adadaa-c3e5-46af-940c-0214a84f8a3c tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:58:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-655d9fd8-3df1-4570-b76e-95ede670d8c4 req-f6adadaa-c3e5-46af-940c-0214a84f8a3c tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:58:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-655d9fd8-3df1-4570-b76e-95ede670d8c4 req-f6adadaa-c3e5-46af-940c-0214a84f8a3c tempest-ServerActionsTestOtherA-761705016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-83b734a9-dab5-4836-afbc-c3a40ffa708d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd85c7262-3e0e-4692-9c80-3713ccb8f8e7', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 18:58:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-655d9fd8-3df1-4570-b76e-95ede670d8c4 req-f6adadaa-c3e5-46af-940c-0214a84f8a3c tempest-ServerActionsTestOtherA-761705016 None] attachment_update completed successfully. Aug 26 18:59:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-78f96942-9d5c-470d-8d6d-35b6ff7b5669 tempest-GroupSnapshotsTest-1520561909 None] Group tempest-GroupSnapshotsTest-Group-1098630918: creating Aug 26 18:59:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-78f96942-9d5c-470d-8d6d-35b6ff7b5669 tempest-GroupSnapshotsTest-1520561909 None] Group tempest-GroupSnapshotsTest-Group-1098630918: created successfully Aug 26 18:59:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-78f96942-9d5c-470d-8d6d-35b6ff7b5669 tempest-GroupSnapshotsTest-1520561909 None] Create group completed successfully. Aug 26 18:59:04 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2fe37aee-c3df-492f-9ff1-15eb6225244f tempest-GroupSnapshotsV319Test-547780896 None] Group tempest-GroupSnapshotsV319Test-Group-526374787: creating Aug 26 18:59:04 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2fe37aee-c3df-492f-9ff1-15eb6225244f tempest-GroupSnapshotsV319Test-547780896 None] Group tempest-GroupSnapshotsV319Test-Group-526374787: created successfully Aug 26 18:59:04 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2fe37aee-c3df-492f-9ff1-15eb6225244f tempest-GroupSnapshotsV319Test-547780896 None] Create group completed successfully. Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Flow 'volume_create_manager' (ad9035c0-f17e-4326-8035-4eb738b11437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d73ab9-5f2a-4039-99d8-e53f903c7e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d73ab9-5f2a-4039-99d8-e53f903c7e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727545105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7336026b-52ed-4f94-bd5a-a6fa460679ba,host='devstack@QuobyteHD#QuobyteHD',id=adf10687-6543-4c32-aaaf-fdec46b9cebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8454a1b96dd4440683690fd64de4cf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:06Z,use_quota=True,user_id='0e19333403034762814d2da460dc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc2e7945-120c-4fc6-b6a0-d41c1d2dcf79),volume_type_id=bc2e7945-120c-4fc6-b6a0-d41c1d2dcf79)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc6021e-639d-49fb-a46c-7256f16302c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc6021e-639d-49fb-a46c-7256f16302c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff8d247-e2b1-4044-955a-28ff5b1cf8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff8d247-e2b1-4044-955a-28ff5b1cf8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf10687-6543-4c32-aaaf-fdec46b9cebb', 'volume_name': 'volume-adf10687-6543-4c32-aaaf-fdec46b9cebb', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63be215-0dd9-4a6e-97c2-72d0b71979dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63be215-0dd9-4a6e-97c2-72d0b71979dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8200622e-3bf3-404f-aac2-b97ff9106e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:05 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Volume adf10687-6543-4c32-aaaf-fdec46b9cebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf10687-6543-4c32-aaaf-fdec46b9cebb', 'volume_size': 1} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7336026b-52ed-4f94-bd5a-a6fa460679ba,created_at=2026-08-26T16:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727545105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7336026b-52ed-4f94-bd5a-a6fa460679ba,host='devstack@QuobyteHD#QuobyteHD',id=adf10687-6543-4c32-aaaf-fdec46b9cebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8454a1b96dd4440683690fd64de4cf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:06Z,use_quota=True,user_id='0e19333403034762814d2da460dc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc2e7945-120c-4fc6-b6a0-d41c1d2dcf79),volume_type_id=bc2e7945-120c-4fc6-b6a0-d41c1d2dcf79)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Creating volume adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:59:05 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:59:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:05 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb 1073741824 Aug 26 18:59:05 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:06 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb 1073741824" returned: 0 in 0.619s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:06 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb Aug 26 18:59:06 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Flow 'volume_create_manager' (5c3e3d78-e5de-4590-bacf-2a810922e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3791b68-1ed2-40b5-bc44-4e0b084364e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3791b68-1ed2-40b5-bc44-4e0b084364e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613356262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d7cf981-c100-4adb-be95-e6e072250222,host='devstack@QuobyteHD#QuobyteHD',id=4ef1e6d0-4a44-442a-b10f-32efb7dc62e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98471d33d5044f65aa6a435dbf632a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:07Z,use_quota=True,user_id='a37fadc6b73045f6bb2cd1ccaccf2da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89436d70-2e81-4a4a-8b5d-04844a6da636),volume_type_id=89436d70-2e81-4a4a-8b5d-04844a6da636)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21090c1-0d18-481d-b675-fc54effd7662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21090c1-0d18-481d-b675-fc54effd7662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8fc497-868e-4efa-ad57-212e9702ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8fc497-868e-4efa-ad57-212e9702ca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef1e6d0-4a44-442a-b10f-32efb7dc62e3', 'volume_name': 'volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162ade8b-57b8-4571-addf-7e88f6c453e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162ade8b-57b8-4571-addf-7e88f6c453e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f5958f-c558-482f-8414-03167ec4555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:06 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Volume 4ef1e6d0-4a44-442a-b10f-32efb7dc62e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3', 'volume_size': 1} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:06 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb" returned: 0 in 0.353s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d7cf981-c100-4adb-be95-e6e072250222,created_at=2026-08-26T16:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613356262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d7cf981-c100-4adb-be95-e6e072250222,host='devstack@QuobyteHD#QuobyteHD',id=4ef1e6d0-4a44-442a-b10f-32efb7dc62e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98471d33d5044f65aa6a435dbf632a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:07Z,use_quota=True,user_id='a37fadc6b73045f6bb2cd1ccaccf2da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89436d70-2e81-4a4a-8b5d-04844a6da636),volume_type_id=89436d70-2e81-4a4a-8b5d-04844a6da636)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Creating volume 4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:59:06 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8200622e-3bf3-404f-aac2-b97ff9106e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf10687-6543-4c32-aaaf-fdec46b9cebb', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670e896b-a171-46e2-acfd-efad03693b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:06 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 1073741824 Aug 26 18:59:06 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:06 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Volume volume-adf10687-6543-4c32-aaaf-fdec46b9cebb (adf10687-6543-4c32-aaaf-fdec46b9cebb): created successfully Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670e896b-a171-46e2-acfd-efad03693b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Flow 'volume_create_manager' (ad9035c0-f17e-4326-8035-4eb738b11437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:06 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2c3b924c-09f8-4b0e-9782-e1b433d8ef63 tempest-GroupSnapshotsTest-1520561909 None] Created volume successfully. Aug 26 18:59:07 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 1073741824" returned: 0 in 0.443s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:07 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 Aug 26 18:59:07 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:07 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" returned: 0 in 0.268s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:59:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f5958f-c558-482f-8414-03167ec4555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35414c53-b8c3-4f86-b908-b3b46ca48273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:07 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Volume volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 (4ef1e6d0-4a44-442a-b10f-32efb7dc62e3): created successfully Aug 26 18:59:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35414c53-b8c3-4f86-b908-b3b46ca48273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Flow 'volume_create_manager' (5c3e3d78-e5de-4590-bacf-2a810922e301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:07 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4ec85d16-8025-4f35-92e4-8fd079d90ec3 tempest-GroupSnapshotsV319Test-547780896 None] Created volume successfully. Aug 26 18:59:08 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] GroupSnapshot 24e73f9d-08f8-4fa2-8ff5-a7b50414213c: creating. Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Group snapshot 24e73f9d-08f8-4fa2-8ff5-a7b50414213c: creating. {{(pid=93671) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Creating offline snapshot 6714f3a8-11c0-481d-9d1c-408d0f2c8c90 of volume 4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[70067994-e690-45f7-b0f7-68216f728b40]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:08 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] GroupSnapshot ce037795-8edb-4a36-bc56-01f6ae7fb094: creating. Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Group snapshot ce037795-8edb-4a36-bc56-01f6ae7fb094: creating. {{(pid=93671) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:08 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 Aug 26 18:59:08 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:08 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" returned: 0 in 0.514s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:08 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 1G Aug 26 18:59:08 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:09 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 1G" returned: 0 in 0.580s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:09 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 Aug 26 18:59:09 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:09 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90" returned: 0 in 0.389s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:09 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:59:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:09 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 Aug 26 18:59:09 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:10 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90" returned: 0 in 0.283s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:10 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.info Aug 26 18:59:10 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:10 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.info" returned: 0 in 0.341s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:10 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:10 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.info Aug 26 18:59:10 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:10 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.info" returned: 0 in 0.286s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.284s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Creating offline snapshot 40bcb4b7-ec3e-4bda-b9da-093beacb83b6 of volume adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f16d27f-d150-4ce8-b6d4-72b40da060a5]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-1159b84c-3013-4fff-a24c-e84a5ff29efe tempest-GroupSnapshotsV319Test-547780896 None] group_snapshot 24e73f9d-08f8-4fa2-8ff5-a7b50414213c: created successfully Aug 26 18:59:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-20af88b1-fd6e-402c-8420-28b828a96c3a req-c0220082-7ee5-490e-b780-fa9f0d6dc3f1 tempest-TestMinimumBasicScenario-736670518 None] Terminate volume connection completed successfully. Aug 26 18:59:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-20af88b1-fd6e-402c-8420-28b828a96c3a req-c0220082-7ee5-490e-b780-fa9f0d6dc3f1 tempest-TestMinimumBasicScenario-736670518 None] Deleting attachment 6817813c-0368-4584-9e11-9a04abdc93b4. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:59:11 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb Aug 26 18:59:11 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:11 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb" returned: 0 in 0.430s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:11 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 1G Aug 26 18:59:11 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Acquiring lock "cinder-749b38f4-4bc8-44b2-a033-110aed0de8f4-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Lock "cinder-749b38f4-4bc8-44b2-a033-110aed0de8f4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Acquiring lock "cinder-quobyte-749b38f4-4bc8-44b2-a033-110aed0de8f4" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Lock "cinder-quobyte-749b38f4-4bc8-44b2-a033-110aed0de8f4" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:11 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e13d918-9f3e-4616-aedb-e78b0596ac0d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:12 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 1G" returned: 0 in 0.675s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf10687-6543-4c32-aaaf-fdec46b9cebb -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:12 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf10687-6543-4c32-aaaf-fdec46b9cebb -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 Aug 26 18:59:12 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:12 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 Aug 26 18:59:12 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:12 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] group_snapshot 24e73f9d-08f8-4fa2-8ff5-a7b50414213c: deleting Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] group_snapshot 24e73f9d-08f8-4fa2-8ff5-a7b50414213c: deleting {{(pid=93671) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Acquiring lock "cinder-quobyte-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Lock "cinder-quobyte-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Acquiring lock "cinder-quobyte-6714f3a8-11c0-481d-9d1c-408d0f2c8c90" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Lock "cinder-quobyte-6714f3a8-11c0-481d-9d1c-408d0f2c8c90" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Deleting offline snapshot 6714f3a8-11c0-481d-9d1c-408d0f2c8c90 of volume 4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] snapshot_file for this snap is: volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6946303e-0bb3-419f-937f-9930255bba03]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:12 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4" returned: 0 in 0.620s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:12 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf10687-6543-4c32-aaaf-fdec46b9cebb -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6" returned: 0 in 0.547s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:12 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:12 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 Aug 26 18:59:12 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4 Aug 26 18:59:12 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:12 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:12 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 Aug 26 18:59:12 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:12 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6" returned: 0 in 0.280s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:12 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90" returned: 0 in 0.518s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:59:12 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.info Aug 26 18:59:12 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:12 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee921819-a2da-4491-a8a1-3a7ad721e744]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-749b38f4-4bc8-44b2-a033-110aed0de8f4" returned: 0 in 0.423s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Lock "cinder-quobyte-749b38f4-4bc8-44b2-a033-110aed0de8f4" released by "delete_volume" :: held 1.100s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Created reservations ['8f87b68c-de51-496e-95c4-f0f5fbea9901', 'b2aefba7-f5c9-421c-a257-b1ae224abf39', 'dede1990-beef-475a-a7bc-926b789f4216', '3bbb547d-263a-4619-8e6e-18a86f9bed78'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:13 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 Aug 26 18:59:13 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:13 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:13 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:13 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.info" returned: 0 in 0.384s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:13 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:13 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.info Aug 26 18:59:13 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:13 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" returned: 0 in 0.470s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:13 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.347s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:59:13 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 Aug 26 18:59:13 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Deleted volume successfully. Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f2670641-e2bc-4d77-bce8-86e91afdad77 tempest-TestMinimumBasicScenario-736670518 None] Lock "cinder-749b38f4-4bc8-44b2-a033-110aed0de8f4-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:13 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.info" returned: 0 in 0.324s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-310d5a0c-452a-4af8-89c1-c958816e27a3 tempest-GroupSnapshotsTest-1520561909 None] group_snapshot ce037795-8edb-4a36-bc56-01f6ae7fb094: created successfully Aug 26 18:59:13 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90" returned: 0 in 0.433s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:13 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90 Aug 26 18:59:13 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:14 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3.6714f3a8-11c0-481d-9d1c-408d0f2c8c90" returned: 0 in 0.283s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Lock "cinder-quobyte-6714f3a8-11c0-481d-9d1c-408d0f2c8c90" released by "_delete_snapshot" :: held 1.859s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Lock "cinder-quobyte-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" released by "delete_snapshot" :: held 1.923s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:14 devstack cinder-volume[93671]: WARNING cinder.quota [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-976340912 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-976340912, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:14 devstack cinder-volume[93671]: WARNING cinder.quota [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-976340912 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-976340912, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:14 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] Created reservations ['84c81f4e-b8ee-4a9b-8b49-e6a41637ed37', 'da7f21b4-d2f5-4e47-acd8-77abf18a3a40', 'b9f81263-526b-492d-85ce-f3ebf4e770ca', 'df7ede00-e5ad-4b2f-9589-c6cb043cdce4'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7d799c98-b3c3-46b9-9b32-6cf9e3119265 tempest-GroupSnapshotsV319Test-547780896 None] group_snapshot 24e73f9d-08f8-4fa2-8ff5-a7b50414213c: deleted successfully Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Acquiring lock "cinder-quobyte-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Lock "cinder-quobyte-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" acquired by "delete_volume" :: waited 0.064s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[78689bc3-1ecb-4cd7-9b10-ff2bb8924e1d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-40bcb4b7-ec3e-4bda-b9da-093beacb83b6-b3d72367-f99a-484f-9b88-d79b6034e2ec" by "_create_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-40bcb4b7-ec3e-4bda-b9da-093beacb83b6-b3d72367-f99a-484f-9b88-d79b6034e2ec" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Creating volume b3d72367-f99a-484f-9b88-d79b6034e2ec from snapshot 40bcb4b7-ec3e-4bda-b9da-093beacb83b6 {{(pid=93671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-b3d72367-f99a-484f-9b88-d79b6034e2ec" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:15 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-b3d72367-f99a-484f-9b88-d79b6034e2ec" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:15 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] snapshot: 40bcb4b7-ec3e-4bda-b9da-093beacb83b6, volume: b3d72367-f99a-484f-9b88-d79b6034e2ec, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50ff05b-c5e2-4d27-956e-16c032959b15]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:15 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 Aug 26 18:59:15 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:15 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" returned: 0 in 0.528s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:15 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3 Aug 26 18:59:15 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:16 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6" returned: 0 in 0.684s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adf10687-6543-4c32-aaaf-fdec46b9cebb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff7ab3-3900-4cb6-9a8b-e5d21a172162]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:16 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" returned: 0 in 0.450s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Lock "cinder-quobyte-4ef1e6d0-4a44-442a-b10f-32efb7dc62e3" released by "delete_volume" :: held 1.080s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:16 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb Aug 26 18:59:16 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Created reservations ['de14bd85-41a9-4cf6-bd0f-31672afca11f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:16 devstack cinder-volume[93671]: WARNING cinder.quota [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-976340912 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-976340912, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Created reservations ['aed589c3-3a8a-4782-a160-cdfc4c56392e', '765e12a5-3cf0-4b9b-813f-cba4a49ae683', 'e0a5575a-8b33-4364-b355-fc71d42e3f3e', '8d6a6ea5-6c44-486a-a34d-f6aef43dd5b8'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:16 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:16 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:16 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb" returned: 0 in 0.612s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 18:59:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:16 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec Aug 26 18:59:16 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:17 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.464s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:17 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:59:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-35ff7c1f-d370-4a47-ae6c-afe3d1213e66 tempest-GroupSnapshotsV319Test-547780896 None] Delete group completed successfully. Aug 26 18:59:23 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec" returned: 0 in 6.253s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:23 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 18:59:23 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Converted 1024.00 MB image at 163.74 MB/s Aug 26 18:59:23 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:59:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:23 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec Aug 26 18:59:23 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:23 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec" returned: 0 in 0.347s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-b3d72367-f99a-484f-9b88-d79b6034e2ec" released by "_copy_volume_from_snapshot" :: held 8.063s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-40bcb4b7-ec3e-4bda-b9da-093beacb83b6-b3d72367-f99a-484f-9b88-d79b6034e2ec" released by "_create_volume_from_snapshot" :: held 8.161s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.186s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:23 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-bc543cf0-9ab6-4f5d-bd96-72b7c3a2afc5 tempest-GroupSnapshotsTest-1520561909 None] Create group from source-snapshot-ce037795-8edb-4a36-bc56-01f6ae7fb094 completed successfully. Aug 26 18:59:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-b3d72367-f99a-484f-9b88-d79b6034e2ec" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-b3d72367-f99a-484f-9b88-d79b6034e2ec" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:24 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65f2dfa-6f25-4622-ba70-5b9bb63e5d2d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:24 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec Aug 26 18:59:24 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:25 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec" returned: 0 in 0.397s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:25 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec Aug 26 18:59:25 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:25 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b3d72367-f99a-484f-9b88-d79b6034e2ec" returned: 0 in 0.272s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-b3d72367-f99a-484f-9b88-d79b6034e2ec" released by "delete_volume" :: held 0.735s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['dc31bd9e-6f1e-447a-a7f1-53d428c98ac9'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:25 devstack cinder-volume[93671]: WARNING cinder.quota [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-252340918 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-252340918, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:25 devstack cinder-volume[93671]: WARNING cinder.quota [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-252340918 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-252340918, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['b3eb7917-b6d0-4cb8-99f5-b057f9cddec9', '1d52578a-7632-4569-9fca-6d9e9de4453e', '6026ef3d-ea68-43be-962c-f41716513f1c', '7cbf80c9-0b36-4fd8-9d04-4197ca569160'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:25 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:25 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:25 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] group_snapshot ce037795-8edb-4a36-bc56-01f6ae7fb094: deleting Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] group_snapshot ce037795-8edb-4a36-bc56-01f6ae7fb094: deleting {{(pid=93671) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 18:59:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-adf10687-6543-4c32-aaaf-fdec46b9cebb" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-adf10687-6543-4c32-aaaf-fdec46b9cebb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-40bcb4b7-ec3e-4bda-b9da-093beacb83b6" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-40bcb4b7-ec3e-4bda-b9da-093beacb83b6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Deleting offline snapshot 40bcb4b7-ec3e-4bda-b9da-093beacb83b6 of volume adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:59:26 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] snapshot_file for this snap is: volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:59:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4758c8da-238b-40f6-b34d-66eea5754324 tempest-GroupSnapshotsTest-1520561909 None] Delete group completed successfully. Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[38744948-4415-43a8-8ab6-234dd02493e6]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:26 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 Aug 26 18:59:26 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:26 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6" returned: 0 in 0.629s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adf10687-6543-4c32-aaaf-fdec46b9cebb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[120b72b5-a5ac-44fe-9137-161842309fba]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:26 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb Aug 26 18:59:26 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:27 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb" returned: 0 in 0.765s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:27 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 Aug 26 18:59:27 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:28 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6" returned: 0 in 0.494s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:28 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6 Aug 26 18:59:28 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:28 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb.40bcb4b7-ec3e-4bda-b9da-093beacb83b6" returned: 0 in 0.339s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-40bcb4b7-ec3e-4bda-b9da-093beacb83b6" released by "_delete_snapshot" :: held 2.396s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-adf10687-6543-4c32-aaaf-fdec46b9cebb" released by "delete_snapshot" :: held 2.430s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:28 devstack cinder-volume[93671]: WARNING cinder.quota [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-252340918 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-252340918, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:28 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['95ce8677-5282-46bc-b433-d8023f96013a', '02f80fa5-2b4e-46b0-9e4e-8d663d411d1b', '9a3ed7a6-958b-429d-95f5-687014bdebf5', 'fed5a341-3020-443a-82dd-e48df2d4ef77'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b4717923-8337-481b-891b-be36fd5d1a90 tempest-GroupSnapshotsTest-1520561909 None] group_snapshot ce037795-8edb-4a36-bc56-01f6ae7fb094: deleted successfully Aug 26 18:59:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-adf10687-6543-4c32-aaaf-fdec46b9cebb" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-adf10687-6543-4c32-aaaf-fdec46b9cebb" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c11dc49-639e-4609-bc41-86ec37203003]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:30 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb Aug 26 18:59:30 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:30 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb" returned: 0 in 0.497s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:30 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb Aug 26 18:59:30 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:30 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-adf10687-6543-4c32-aaaf-fdec46b9cebb" returned: 0 in 0.362s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-adf10687-6543-4c32-aaaf-fdec46b9cebb" released by "delete_volume" :: held 0.928s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['62023243-5b53-4c1b-b246-c474d3405ab2'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:31 devstack cinder-volume[93671]: WARNING cinder.db.api [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-252340918'] Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['b6b242ac-1341-4cf5-80c2-224f582e6e39', '46d794a2-12bd-4b60-a492-33652fb62076', '097f64a6-e3d9-4e2f-aad4-c9c04dbee1a7', 'c60a91a2-dcdc-473a-a59a-d35c93adffa4'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:31 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:31 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:31 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.373s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:31 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:59:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-204a858a-234d-463d-85ff-4549ce613523 tempest-GroupSnapshotsTest-1520561909 None] Delete group completed successfully. Aug 26 18:59:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b18a9f31-39e5-4dee-8a88-e89a78dad1ca tempest-GroupSnapshotsTest-1520561909 None] Group tempest-GroupSnapshotsTest-Group-494207348: creating Aug 26 18:59:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b18a9f31-39e5-4dee-8a88-e89a78dad1ca tempest-GroupSnapshotsTest-1520561909 None] Group tempest-GroupSnapshotsTest-Group-494207348: created successfully Aug 26 18:59:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b18a9f31-39e5-4dee-8a88-e89a78dad1ca tempest-GroupSnapshotsTest-1520561909 None] Create group completed successfully. Aug 26 18:59:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-aea9c334-3296-4c14-8397-137f8eb3517a tempest-GroupsTest-943085927 None] Group tempest-Group1-795318248: creating Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Flow 'volume_create_manager' (0542007a-08b4-4fa9-b35a-53709057d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d022d8c6-25f1-47c2-810f-3b1d8ce8f2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d022d8c6-25f1-47c2-810f-3b1d8ce8f2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338485698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7404cc38-0118-4874-94c2-d8808c35df01,host='devstack@QuobyteHD#QuobyteHD',id=cd75a983-25b4-406d-a0dd-b5a2cb6b03ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8454a1b96dd4440683690fd64de4cf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:34Z,use_quota=True,user_id='0e19333403034762814d2da460dc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83778b03-ed14-4c9c-b323-3fc30306cc7d),volume_type_id=83778b03-ed14-4c9c-b323-3fc30306cc7d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8618a9ff-67a4-4db5-9a2f-57661c91a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8618a9ff-67a4-4db5-9a2f-57661c91a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177e03f3-5a18-4fec-b9e3-02008e37e510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177e03f3-5a18-4fec-b9e3-02008e37e510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd75a983-25b4-406d-a0dd-b5a2cb6b03ee', 'volume_name': 'volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fce9d2e-6ceb-4afc-8983-dd298227b09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fce9d2e-6ceb-4afc-8983-dd298227b09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded8c1dc-c23f-496c-93ca-51a5cd87a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Volume cd75a983-25b4-406d-a0dd-b5a2cb6b03ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee', 'volume_size': 1} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7404cc38-0118-4874-94c2-d8808c35df01,created_at=2026-08-26T16:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338485698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7404cc38-0118-4874-94c2-d8808c35df01,host='devstack@QuobyteHD#QuobyteHD',id=cd75a983-25b4-406d-a0dd-b5a2cb6b03ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8454a1b96dd4440683690fd64de4cf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:34Z,use_quota=True,user_id='0e19333403034762814d2da460dc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83778b03-ed14-4c9c-b323-3fc30306cc7d),volume_type_id=83778b03-ed14-4c9c-b323-3fc30306cc7d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Creating volume cd75a983-25b4-406d-a0dd-b5a2cb6b03ee {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:59:33 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:59:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-aea9c334-3296-4c14-8397-137f8eb3517a tempest-GroupsTest-943085927 None] Group tempest-Group1-795318248: created successfully Aug 26 18:59:34 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee 1073741824 Aug 26 18:59:34 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-aea9c334-3296-4c14-8397-137f8eb3517a tempest-GroupsTest-943085927 None] Create group completed successfully. Aug 26 18:59:34 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee 1073741824" returned: 0 in 0.482s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:34 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee Aug 26 18:59:34 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:34 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" returned: 0 in 0.321s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:59:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0df95b7d-fddb-44be-ad86-694a7e3667c1 tempest-GroupsTest-943085927 None] Group tempest-Group2-1145776400: creating Aug 26 18:59:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded8c1dc-c23f-496c-93ca-51a5cd87a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29eab0a9-fe0a-4eb2-963a-8f8005c7f1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:34 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Volume volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee (cd75a983-25b4-406d-a0dd-b5a2cb6b03ee): created successfully Aug 26 18:59:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29eab0a9-fe0a-4eb2-963a-8f8005c7f1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Flow 'volume_create_manager' (0542007a-08b4-4fa9-b35a-53709057d273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0df95b7d-fddb-44be-ad86-694a7e3667c1 tempest-GroupsTest-943085927 None] Group tempest-Group2-1145776400: created successfully Aug 26 18:59:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f5d21f53-a105-41c9-8c67-8d1d6c081d8a tempest-GroupSnapshotsTest-1520561909 None] Created volume successfully. Aug 26 18:59:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0df95b7d-fddb-44be-ad86-694a7e3667c1 tempest-GroupsTest-943085927 None] Create group completed successfully. Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Flow 'volume_create_manager' (201cd2a2-9c93-4f5b-bac0-c41695f88220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65af1e8-8e27-4930-84b8-5258f280a999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e65af1e8-8e27-4930-84b8-5258f280a999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-774182052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ac7fc54-b7f8-49e4-aef8-cc0ff9b39d11,host='devstack@QuobyteHD#QuobyteHD',id=bf9438ac-225e-461e-a424-d69dc71424cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c97576db8d46449351a682039c4581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:37Z,use_quota=True,user_id='f2481068487a4f4eb54458194da2bd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91e6b0f8-c38c-4a00-9f8e-6c04aeb9a9a3),volume_type_id=91e6b0f8-c38c-4a00-9f8e-6c04aeb9a9a3)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e0f7fa-f599-4a36-9a79-02d6de004f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e0f7fa-f599-4a36-9a79-02d6de004f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b95953-2d3c-45ea-af6e-137aac30e43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b95953-2d3c-45ea-af6e-137aac30e43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9438ac-225e-461e-a424-d69dc71424cb', 'volume_name': 'volume-bf9438ac-225e-461e-a424-d69dc71424cb', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0af209a-e314-4a2f-856b-c5756fdcedec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0af209a-e314-4a2f-856b-c5756fdcedec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf5eeeb-30d6-4e51-b8ea-25dfda6b9876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:36 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Volume bf9438ac-225e-461e-a424-d69dc71424cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9438ac-225e-461e-a424-d69dc71424cb', 'volume_size': 1} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ac7fc54-b7f8-49e4-aef8-cc0ff9b39d11,created_at=2026-08-26T16:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-774182052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ac7fc54-b7f8-49e4-aef8-cc0ff9b39d11,host='devstack@QuobyteHD#QuobyteHD',id=bf9438ac-225e-461e-a424-d69dc71424cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c97576db8d46449351a682039c4581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:37Z,use_quota=True,user_id='f2481068487a4f4eb54458194da2bd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91e6b0f8-c38c-4a00-9f8e-6c04aeb9a9a3),volume_type_id=91e6b0f8-c38c-4a00-9f8e-6c04aeb9a9a3)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Creating volume bf9438ac-225e-461e-a424-d69dc71424cb {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:59:36 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:59:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:36 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb 1073741824 Aug 26 18:59:36 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Flow 'volume_create_manager' (66d9ce6d-8911-425b-a63d-5a71a87d6d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd07a4e-21d9-4bf6-a164-6d6666945614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd07a4e-21d9-4bf6-a164-6d6666945614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671917934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7404cc38-0118-4874-94c2-d8808c35df01,host='devstack@QuobyteHD#QuobyteHD',id=70517693-d236-4897-ba46-461ccb95201f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8454a1b96dd4440683690fd64de4cf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:37Z,use_quota=True,user_id='0e19333403034762814d2da460dc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83778b03-ed14-4c9c-b323-3fc30306cc7d),volume_type_id=83778b03-ed14-4c9c-b323-3fc30306cc7d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa189ff-68f7-4b2f-ac8f-94563562fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa189ff-68f7-4b2f-ac8f-94563562fce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8c92d9-97db-4c93-a863-8ae01015e8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8c92d9-97db-4c93-a863-8ae01015e8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70517693-d236-4897-ba46-461ccb95201f', 'volume_name': 'volume-70517693-d236-4897-ba46-461ccb95201f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b4099e-3575-4021-af3b-a7520ee45b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b4099e-3575-4021-af3b-a7520ee45b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1babca3e-2dfa-4205-8c54-1c1919f649b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:37 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Volume 70517693-d236-4897-ba46-461ccb95201f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70517693-d236-4897-ba46-461ccb95201f', 'volume_size': 1} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:37 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb 1073741824" returned: 0 in 0.550s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:37 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb Aug 26 18:59:37 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:37 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb" returned: 0 in 0.325s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7404cc38-0118-4874-94c2-d8808c35df01,created_at=2026-08-26T16:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671917934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7404cc38-0118-4874-94c2-d8808c35df01,host='devstack@QuobyteHD#QuobyteHD',id=70517693-d236-4897-ba46-461ccb95201f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8454a1b96dd4440683690fd64de4cf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:37Z,use_quota=True,user_id='0e19333403034762814d2da460dc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83778b03-ed14-4c9c-b323-3fc30306cc7d),volume_type_id=83778b03-ed14-4c9c-b323-3fc30306cc7d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Creating volume 70517693-d236-4897-ba46-461ccb95201f {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:59:37 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:37 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f 1073741824 Aug 26 18:59:37 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf5eeeb-30d6-4e51-b8ea-25dfda6b9876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9438ac-225e-461e-a424-d69dc71424cb', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ab2191-3319-4abd-a9ad-24283c72fef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:37 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Volume volume-bf9438ac-225e-461e-a424-d69dc71424cb (bf9438ac-225e-461e-a424-d69dc71424cb): created successfully Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ab2191-3319-4abd-a9ad-24283c72fef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Flow 'volume_create_manager' (201cd2a2-9c93-4f5b-bac0-c41695f88220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:37 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9fcc68e4-cf6a-47ea-9a48-6e4a539f2898 tempest-GroupsTest-943085927 None] Created volume successfully. Aug 26 18:59:38 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f 1073741824" returned: 0 in 0.449s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:38 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f Aug 26 18:59:38 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:38 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f" returned: 0 in 0.251s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:59:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1babca3e-2dfa-4205-8c54-1c1919f649b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70517693-d236-4897-ba46-461ccb95201f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16da347f-e09f-4863-9274-b651fc34f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:38 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Volume volume-70517693-d236-4897-ba46-461ccb95201f (70517693-d236-4897-ba46-461ccb95201f): created successfully Aug 26 18:59:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16da347f-e09f-4863-9274-b651fc34f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Flow 'volume_create_manager' (66d9ce6d-8911-425b-a63d-5a71a87d6d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8fa63c48-8dc4-4886-bfc7-b9783629e8e4 tempest-GroupSnapshotsTest-1520561909 None] Created volume successfully. Aug 26 18:59:39 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-75f96c88-97da-4843-a586-178322fa37ca tempest-GroupSnapshotsTest-1520561909 None] Update group completed successfully. Aug 26 18:59:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Acquiring lock "cinder-quobyte-bf9438ac-225e-461e-a424-d69dc71424cb" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Lock "cinder-quobyte-bf9438ac-225e-461e-a424-d69dc71424cb" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:39 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a64071-f5fa-4fda-83b4-758eae3c1dbd]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:39 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb Aug 26 18:59:39 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:40 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb" returned: 0 in 0.392s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:40 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb Aug 26 18:59:40 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:40 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf9438ac-225e-461e-a424-d69dc71424cb" returned: 0 in 0.290s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Lock "cinder-quobyte-bf9438ac-225e-461e-a424-d69dc71424cb" released by "delete_volume" :: held 0.734s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Created reservations ['8e9560b2-7674-4409-b349-8ca75519133f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:40 devstack cinder-volume[93671]: WARNING cinder.quota [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-932285218 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-932285218, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:40 devstack cinder-volume[93671]: WARNING cinder.quota [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-932285218 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-932285218, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Created reservations ['77b2960c-93ca-4843-a43c-9ac6327d24ec', 'fde31800-510f-4293-8c05-708bf2dba933', '661b29a9-84a8-4d2c-a895-ad1a12a8619e', '370014ad-2902-4af0-b3d8-edf0f1348b6d'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:40 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:40 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ca43d3c6-17db-427e-b79b-233e14f81f3c tempest-GroupSnapshotsTest-1520561909 None] Update group completed successfully. Aug 26 18:59:40 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.278s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:59:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-65929dc4-f59c-40a6-9b08-2b60bcb0a51f tempest-GroupsTest-943085927 None] Delete group completed successfully. Aug 26 18:59:40 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] Created reservations ['f2442b50-139c-409b-800e-c5aecaa649da'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:41 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:41 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:41 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.388s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:41 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:59:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d6cca4ba-0e01-4ec3-941e-514d1ed73279 tempest-GroupsTest-943085927 None] Delete group completed successfully. Aug 26 18:59:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-327c8e47-b265-444f-8deb-16e1efdca7ec tempest-GroupSnapshotsTest-1520561909 None] Update group completed successfully. Aug 26 18:59:42 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-02c4e8c9-0106-475f-862c-8565e088e8f4 tempest-GroupsTest-943085927 None] Group tempest-GroupsTest-Group-825373503: creating Aug 26 18:59:42 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-02c4e8c9-0106-475f-862c-8565e088e8f4 tempest-GroupsTest-943085927 None] Group tempest-GroupsTest-Group-825373503: created successfully Aug 26 18:59:42 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-02c4e8c9-0106-475f-862c-8565e088e8f4 tempest-GroupsTest-943085927 None] Create group completed successfully. Aug 26 18:59:43 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8863390e-f2bf-4abd-a346-77def6ba91b2 tempest-GroupSnapshotsTest-1520561909 None] Update group completed successfully. Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Flow 'volume_create_manager' (f75eab34-1592-4ee5-9c53-8fef481919ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483c2700-4355-46ba-b92e-5297f330b3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483c2700-4355-46ba-b92e-5297f330b3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-787638583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99aebc8e-1356-4319-8bd2-bb6a777eabf4,host='devstack@QuobyteHD#QuobyteHD',id=d0c904ef-19f3-4577-b47e-d49e050a0993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c97576db8d46449351a682039c4581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:45Z,use_quota=True,user_id='f2481068487a4f4eb54458194da2bd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f604ece1-f74b-4270-b7e3-e84ceefe6bcd),volume_type_id=f604ece1-f74b-4270-b7e3-e84ceefe6bcd)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f44b5a3-ba34-4e5a-8ef2-e7beb237340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f44b5a3-ba34-4e5a-8ef2-e7beb237340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7353e754-7044-4903-9e57-744acd31598f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7353e754-7044-4903-9e57-744acd31598f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c904ef-19f3-4577-b47e-d49e050a0993', 'volume_name': 'volume-d0c904ef-19f3-4577-b47e-d49e050a0993', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4b97ab-3cdc-4e1f-b68b-975f8ce580ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4b97ab-3cdc-4e1f-b68b-975f8ce580ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe397718-821d-4278-9f00-d49aeb1578b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:44 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Volume d0c904ef-19f3-4577-b47e-d49e050a0993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c904ef-19f3-4577-b47e-d49e050a0993', 'volume_size': 1} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99aebc8e-1356-4319-8bd2-bb6a777eabf4,created_at=2026-08-26T16:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-787638583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99aebc8e-1356-4319-8bd2-bb6a777eabf4,host='devstack@QuobyteHD#QuobyteHD',id=d0c904ef-19f3-4577-b47e-d49e050a0993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c97576db8d46449351a682039c4581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:45Z,use_quota=True,user_id='f2481068487a4f4eb54458194da2bd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f604ece1-f74b-4270-b7e3-e84ceefe6bcd),volume_type_id=f604ece1-f74b-4270-b7e3-e84ceefe6bcd)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Creating volume d0c904ef-19f3-4577-b47e-d49e050a0993 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:59:45 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:45 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993 1073741824 Aug 26 18:59:45 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] GroupSnapshot e764b122-51a2-4d44-84e9-0757de160ce1: creating. Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Group snapshot e764b122-51a2-4d44-84e9-0757de160ce1: creating. {{(pid=93671) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:45 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993 1073741824" returned: 0 in 0.691s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=125,cinder:INSERT=28,cinder:UPDATE=116,cinder:DELETE=3 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=120,cinder:INSERT=21,cinder:UPDATE=109,cinder:DELETE=4 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 18:59:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:45 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993 Aug 26 18:59:45 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:46 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993" returned: 0 in 0.341s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.909s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe397718-821d-4278-9f00-d49aeb1578b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c904ef-19f3-4577-b47e-d49e050a0993', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa88d55-750b-402f-84e7-e4ba2ec9af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Creating offline snapshot 2a3956de-3e84-457a-b98d-ddcb73c26e23 of volume cd75a983-25b4-406d-a0dd-b5a2cb6b03ee {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:59:46 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Volume volume-d0c904ef-19f3-4577-b47e-d49e050a0993 (d0c904ef-19f3-4577-b47e-d49e050a0993): created successfully Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa88d55-750b-402f-84e7-e4ba2ec9af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Flow 'volume_create_manager' (f75eab34-1592-4ee5-9c53-8fef481919ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b06085-1d8b-4bed-907a-01757c11dc39]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8454590e-e3f6-49b7-9055-8678bf8a56ba tempest-GroupsTest-943085927 None] Created volume successfully. Aug 26 18:59:46 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee Aug 26 18:59:46 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-e2d94def-6e4b-4552-8131-1aa07d7aa83b tempest-ServerActionsTestOtherA-761705016 None] Terminate volume connection completed successfully. Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-e2d94def-6e4b-4552-8131-1aa07d7aa83b tempest-ServerActionsTestOtherA-761705016 None] Deleting attachment d85c7262-3e0e-4692-9c80-3713ccb8f8e7. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 18:59:46 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" returned: 0 in 0.610s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:46 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 1G Aug 26 18:59:46 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "cinder-83b734a9-dab5-4836-afbc-c3a40ffa708d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Lock "cinder-83b734a9-dab5-4836-afbc-c3a40ffa708d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "cinder-quobyte-83b734a9-dab5-4836-afbc-c3a40ffa708d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Lock "cinder-quobyte-83b734a9-dab5-4836-afbc-c3a40ffa708d" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77353b6-aa40-4cf5-a6ce-7535f9d83cf0]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:47 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d Aug 26 18:59:47 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:47 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 1G" returned: 0 in 0.832s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:47 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 Aug 26 18:59:47 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:47 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d" returned: 0 in 0.765s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:48 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d Aug 26 18:59:48 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:48 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23" returned: 0 in 0.586s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:48 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:48 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 Aug 26 18:59:48 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:48 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-83b734a9-dab5-4836-afbc-c3a40ffa708d" returned: 0 in 0.608s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Lock "cinder-quobyte-83b734a9-dab5-4836-afbc-c3a40ffa708d" released by "delete_volume" :: held 1.454s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 18:59:48 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Flow 'volume_create_manager' (9929aca4-2590-4cd0-9d98-4e3fb11ddb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66310b60-c665-4312-9c20-e009e5333fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23" returned: 0 in 0.449s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66310b60-c665-4312-9c20-e009e5333fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1736632003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99aebc8e-1356-4319-8bd2-bb6a777eabf4,host='devstack@QuobyteHD#QuobyteHD',id=9be3bb58-543b-45c9-8647-5607c8ab1951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c97576db8d46449351a682039c4581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:49Z,use_quota=True,user_id='f2481068487a4f4eb54458194da2bd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f604ece1-f74b-4270-b7e3-e84ceefe6bcd),volume_type_id=f604ece1-f74b-4270-b7e3-e84ceefe6bcd)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03850ac8-1b6f-4c3c-97f9-0204806e77fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03850ac8-1b6f-4c3c-97f9-0204806e77fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b41087-8e8a-4d2d-b627-f0c9e4743893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b41087-8e8a-4d2d-b627-f0c9e4743893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be3bb58-543b-45c9-8647-5607c8ab1951', 'volume_name': 'volume-9be3bb58-543b-45c9-8647-5607c8ab1951', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06815e6-5a98-4fc4-a437-8b9ef0a18820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06815e6-5a98-4fc4-a437-8b9ef0a18820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87c6596-ef09-4d66-8c33-f2aa40263bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:48 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Volume 9be3bb58-543b-45c9-8647-5607c8ab1951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be3bb58-543b-45c9-8647-5607c8ab1951', 'volume_size': 1} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:48 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.info Aug 26 18:59:48 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:48 devstack cinder-volume[93671]: DEBUG cinder.quota [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Created reservations ['586d5b3c-81bb-4729-89e8-9250e802c3d9', 'c531eb89-bed5-42d1-a9aa-29f89ef2daeb', '1b350f0c-0172-4f74-8ff0-2a19993c17d5', '00715948-2dad-4840-92cc-e89107300bf3'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "cinder-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Lock "cinder-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:49 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:49 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "cinder-quobyte-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Lock "cinder-quobyte-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e8a0fb-dc55-427f-91af-5a4308ffcf24]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:49 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.info" returned: 0 in 0.475s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:49 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:49 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.info Aug 26 18:59:49 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:49 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f Aug 26 18:59:49 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:49 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.352s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG cinder.manager [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:59:49 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Deleted volume successfully. Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-62e918fa-1451-4ee1-b505-21c4ff2d3771 req-422f0ccc-d03f-454e-a339-b62d844b353b tempest-ServerActionsTestOtherA-761705016 None] Lock "cinder-83b734a9-dab5-4836-afbc-c3a40ffa708d-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:49 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.info" returned: 0 in 0.383s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.633s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Creating offline snapshot b7164ec2-8bdf-457c-acd2-1144226c1f6c of volume 70517693-d236-4897-ba46-461ccb95201f {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[459d7812-4ab9-4550-8213-c96657007abe]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:49 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f" returned: 0 in 0.534s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:49 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f Aug 26 18:59:49 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:49 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f Aug 26 18:59:49 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:50 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f" returned: 0 in 0.272s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Lock "cinder-quobyte-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f" released by "delete_volume" :: held 0.885s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Created reservations ['685dc56c-1d52-4b6b-86f5-21272ea35680', '6bf67995-bcad-4dcf-8a68-f24232c2e140', '6e352fb8-0514-4a1c-ab7c-d1b3a511a1f7', '5eb25441-bad6-485a-9405-b12044f10e10'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:50 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f" returned: 0 in 0.400s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:50 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c 1G Aug 26 18:59:50 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:50 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:50 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:50 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.291s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:59:50 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Deleted volume successfully. Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d77c4084-36c6-453d-ae0a-4e11f65bc73d tempest-ServerActionsTestOtherA-761705016 None] Lock "cinder-18f800a3-c9d8-4b22-b919-9e8f6ab7be3f-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:50 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c 1G" returned: 0 in 0.489s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70517693-d236-4897-ba46-461ccb95201f -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:50 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70517693-d236-4897-ba46-461ccb95201f -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c Aug 26 18:59:50 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:51 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70517693-d236-4897-ba46-461ccb95201f -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c" returned: 0 in 0.326s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:51 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:51 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c Aug 26 18:59:51 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:51 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c" returned: 0 in 0.253s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:51 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.info Aug 26 18:59:51 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:51 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.info" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:51 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:51 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.info Aug 26 18:59:51 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:51 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.info" returned: 0 in 0.272s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.117s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99aebc8e-1356-4319-8bd2-bb6a777eabf4,created_at=2026-08-26T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1736632003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99aebc8e-1356-4319-8bd2-bb6a777eabf4,host='devstack@QuobyteHD#QuobyteHD',id=9be3bb58-543b-45c9-8647-5607c8ab1951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c97576db8d46449351a682039c4581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T16:59:49Z,use_quota=True,user_id='f2481068487a4f4eb54458194da2bd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f604ece1-f74b-4270-b7e3-e84ceefe6bcd),volume_type_id=f604ece1-f74b-4270-b7e3-e84ceefe6bcd)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Creating volume 9be3bb58-543b-45c9-8647-5607c8ab1951 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 18:59:51 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 18:59:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:51 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951 1073741824 Aug 26 18:59:52 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-171516a2-c522-4e40-94c6-10988dad364d tempest-GroupSnapshotsTest-1520561909 None] group_snapshot e764b122-51a2-4d44-84e9-0757de160ce1: created successfully Aug 26 18:59:52 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951 1073741824" returned: 0 in 0.790s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:52 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951 Aug 26 18:59:52 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] group_snapshot e764b122-51a2-4d44-84e9-0757de160ce1: deleting Aug 26 18:59:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] group_snapshot e764b122-51a2-4d44-84e9-0757de160ce1: deleting {{(pid=93671) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-2a3956de-3e84-457a-b98d-ddcb73c26e23" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-2a3956de-3e84-457a-b98d-ddcb73c26e23" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Deleting offline snapshot 2a3956de-3e84-457a-b98d-ddcb73c26e23 of volume cd75a983-25b4-406d-a0dd-b5a2cb6b03ee {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] snapshot_file for this snap is: volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f350e19d-58d0-4224-b4d1-4db09f836628]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:53 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951" returned: 0 in 0.339s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87c6596-ef09-4d66-8c33-f2aa40263bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be3bb58-543b-45c9-8647-5607c8ab1951', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd60e72-e8ef-4c6a-a09d-d9e7f6efa61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 18:59:53 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Volume volume-9be3bb58-543b-45c9-8647-5607c8ab1951 (9be3bb58-543b-45c9-8647-5607c8ab1951): created successfully Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd60e72-e8ef-4c6a-a09d-d9e7f6efa61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Flow 'volume_create_manager' (9929aca4-2590-4cd0-9d98-4e3fb11ddb66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 18:59:53 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b30b3fc6-7272-48ba-b3d9-6a140b96f204 tempest-GroupsTest-943085927 None] Created volume successfully. Aug 26 18:59:53 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 Aug 26 18:59:53 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:53 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23" returned: 0 in 0.707s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d29baba-e332-4047-a9d7-afa40635b40d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:53 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0ffa39ed-b141-476a-b5d1-f090a75583f2 tempest-GroupsTest-943085927 None] Update group completed successfully. Aug 26 18:59:53 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee Aug 26 18:59:53 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:54 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" returned: 0 in 0.421s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:54 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 Aug 26 18:59:54 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:54 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:54 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:54 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23" returned: 0 in 0.501s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:54 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23 Aug 26 18:59:54 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:55 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.613s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 18:59:55 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee.2a3956de-3e84-457a-b98d-ddcb73c26e23" returned: 0 in 0.459s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-2a3956de-3e84-457a-b98d-ddcb73c26e23" released by "_delete_snapshot" :: held 2.249s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" released by "delete_snapshot" :: held 2.279s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-70517693-d236-4897-ba46-461ccb95201f" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-70517693-d236-4897-ba46-461ccb95201f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-b7164ec2-8bdf-457c-acd2-1144226c1f6c" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-b7164ec2-8bdf-457c-acd2-1144226c1f6c" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Deleting offline snapshot b7164ec2-8bdf-457c-acd2-1144226c1f6c of volume 70517693-d236-4897-ba46-461ccb95201f {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] snapshot_file for this snap is: volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57f3a2-88c8-4b86-a97a-67e7d293a97a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a1f7dc20-eafe-42a0-b2d1-847d37100aaa tempest-GroupsTest-943085927 None] Update group completed successfully. Aug 26 18:59:55 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c Aug 26 18:59:55 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:55 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c" returned: 0 in 0.468s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70517693-d236-4897-ba46-461ccb95201f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 18:59:56 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a0d6aa-2a64-4a6d-b500-20a0d17a944a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:56 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f Aug 26 18:59:56 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:56 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f" returned: 0 in 0.465s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:56 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c Aug 26 18:59:56 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:56 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c" returned: 0 in 0.451s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:56 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c Aug 26 18:59:56 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Acquiring lock "cinder-quobyte-9be3bb58-543b-45c9-8647-5607c8ab1951" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Lock "cinder-quobyte-9be3bb58-543b-45c9-8647-5607c8ab1951" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1024a583-720e-43f3-8371-05a6d3e2688d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:57 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f.b7164ec2-8bdf-457c-acd2-1144226c1f6c" returned: 0 in 0.417s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-b7164ec2-8bdf-457c-acd2-1144226c1f6c" released by "_delete_snapshot" :: held 1.978s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-70517693-d236-4897-ba46-461ccb95201f" released by "delete_snapshot" :: held 2.050s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:57 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951 Aug 26 18:59:57 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:57 devstack cinder-volume[93671]: WARNING cinder.quota [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1563758650 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1563758650, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:57 devstack cinder-volume[93671]: WARNING cinder.quota [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1563758650 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1563758650, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['4157050e-0bb4-4f6f-be83-ce83459f56fc', '9196671d-14d4-4576-a090-3f33039d2619', '828e9426-fdae-4e99-8590-2e5cf72e53ab', 'dc169534-fb58-46b9-a576-a18cd8b0addf'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['03037ac0-e147-4227-b873-7bfc833e97d7', '7650b1aa-8eec-4705-b811-1a76f31f54b9', 'b17f828a-1dfa-43fe-9088-4e7412a8dba8', 'a606c17a-b931-4fe5-b469-023c5fc1f934'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c0066dd7-4ea9-41f3-9487-cc7bc68f59f0 tempest-GroupSnapshotsTest-1520561909 None] group_snapshot e764b122-51a2-4d44-84e9-0757de160ce1: deleted successfully Aug 26 18:59:57 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951" returned: 0 in 0.698s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:58 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951 Aug 26 18:59:58 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:58 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9be3bb58-543b-45c9-8647-5607c8ab1951" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Lock "cinder-quobyte-9be3bb58-543b-45c9-8647-5607c8ab1951" released by "delete_volume" :: held 1.087s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Acquiring lock "cinder-quobyte-d0c904ef-19f3-4577-b47e-d49e050a0993" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Lock "cinder-quobyte-d0c904ef-19f3-4577-b47e-d49e050a0993" acquired by "delete_volume" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:58 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f370883f-f05d-4efc-bac6-6996fcdeb284]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:58 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993 Aug 26 18:59:58 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:58 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993" returned: 0 in 0.505s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:58 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993 Aug 26 18:59:58 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:59 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0c904ef-19f3-4577-b47e-d49e050a0993" returned: 0 in 0.311s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Lock "cinder-quobyte-d0c904ef-19f3-4577-b47e-d49e050a0993" released by "delete_volume" :: held 0.891s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-70517693-d236-4897-ba46-461ccb95201f" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-70517693-d236-4897-ba46-461ccb95201f" acquired by "delete_volume" :: waited 0.050s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4e60a9-50c1-405f-96f0-a7ed3a6f6740]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Created reservations ['fb2cba6e-cfa8-4e5a-bab2-c17fc9c7440c'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:59 devstack cinder-volume[93671]: WARNING cinder.quota [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1397221341 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1397221341, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:59 devstack cinder-volume[93671]: WARNING cinder.quota [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1397221341 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1397221341, it is now deprecated. Please use the default quota class for default quota. Aug 26 18:59:59 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f Aug 26 18:59:59 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Created reservations ['05dedf93-422c-4547-bf6a-72c93fc2354c', 'af2586f1-aa87-437a-971e-538b2a5cd24f', 'ed186b8a-cd2f-4dcf-a08d-1107529c2ce2', 'c7ab2c15-d089-4115-baec-9b2d4b4a6ae6'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Created reservations ['94d6f86c-1279-43dd-9129-30d19f3072ba', '77702e1f-388d-4f01-a30d-ea76b1c78552', '43c75abf-3a82-40eb-8f46-b04a84a18a91', 'b565e88f-eb16-46fe-921f-bbf9889eb7fd'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 18:59:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 18:59:59 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 18:59:59 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:00 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f" returned: 0 in 0.631s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:00 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f Aug 26 19:00:00 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:00 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.464s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:00:00 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-64e85249-d12c-478b-ad0e-215ca8c1eab9 tempest-GroupsTest-943085927 None] Delete group completed successfully. Aug 26 19:00:00 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70517693-d236-4897-ba46-461ccb95201f" returned: 0 in 0.550s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-70517693-d236-4897-ba46-461ccb95201f" released by "delete_volume" :: held 1.307s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1bed42-713c-4dde-84ba-0307fc3fa25b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:00:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:00 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee Aug 26 19:00:00 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:01 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" returned: 0 in 0.504s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:01 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee Aug 26 19:00:01 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Flow 'volume_create_manager' (79819f99-c534-4d1c-b40e-d5ed6105252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff87455-be83-4f6b-8bfc-ee22d07ec5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff87455-be83-4f6b-8bfc-ee22d07ec5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-731074614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb830c1-3b19-431c-9a08-c03d4b223366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3acb6f89d94147946bfb193a8a5fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:01Z,use_quota=True,user_id='53f0acf57f1e427cad32cde5fbc9ccb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c07b59-d7d6-46d0-afa7-331a25773a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c07b59-d7d6-46d0-afa7-331a25773a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700de659-6d7e-41e6-8299-c8019070247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700de659-6d7e-41e6-8299-c8019070247e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb830c1-3b19-431c-9a08-c03d4b223366', 'volume_name': 'volume-bdb830c1-3b19-431c-9a08-c03d4b223366', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4e5879-6e0f-477a-bbb9-0de945a46c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4e5879-6e0f-477a-bbb9-0de945a46c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42d6079-fdb2-4798-97c9-499448765c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:01 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Volume bdb830c1-3b19-431c-9a08-c03d4b223366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb830c1-3b19-431c-9a08-c03d4b223366', 'volume_size': 1} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-731074614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb830c1-3b19-431c-9a08-c03d4b223366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3acb6f89d94147946bfb193a8a5fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:01Z,use_quota=True,user_id='53f0acf57f1e427cad32cde5fbc9ccb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Creating volume bdb830c1-3b19-431c-9a08-c03d4b223366 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:01 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:00:01 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" returned: 0 in 0.432s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-cd75a983-25b4-406d-a0dd-b5a2cb6b03ee" released by "delete_volume" :: held 1.027s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:00:01 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366 1073741824 Aug 26 19:00:01 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:01 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['258af15b-a0fb-4930-b8ee-029fd63e033c'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:00:01 devstack cinder-volume[93671]: WARNING cinder.quota [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1563758650 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1563758650, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['f0a1b401-9b87-4165-abd4-fe81432649cb', '128dc171-b561-4d54-8d1f-b32151572b75', 'f7977bb3-fa9b-446d-8b9f-a8d2dea06fd3', '5721852d-f5c9-4a43-88e2-bb40c7cbcead'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Flow 'volume_create_manager' (9b033890-436f-4b95-8319-a3c4ab24abc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fc3f25-2917-4dbb-b5ad-3cb85eb83d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fc3f25-2917-4dbb-b5ad-3cb85eb83d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2031760504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3acb6f89d94147946bfb193a8a5fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:02Z,use_quota=True,user_id='53f0acf57f1e427cad32cde5fbc9ccb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f460ef-1e5e-4022-bd7b-61cf2e174a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f460ef-1e5e-4022-bd7b-61cf2e174a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417c662b-b0df-4928-9870-d2c291fdae76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417c662b-b0df-4928-9870-d2c291fdae76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7', 'volume_name': 'volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2343e8e-4f01-490e-ab71-2c49a0d62834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2343e8e-4f01-490e-ab71-2c49a0d62834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2028aa-3a55-463f-ada6-b44b3c1787a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:02 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Volume 5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7', 'volume_size': 1} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['53405b5a-8209-4be4-ad69-0dedc2c2ac85', '25f0cf7c-e5e7-4a6d-89d6-1b71ea27961a', 'e147d0e6-bad1-4c8c-85bc-d197754d8172', '4fafe31e-c179-41aa-844c-70454dc87850'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:00:02 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366 1073741824" returned: 0 in 0.858s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:02 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:00:02 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:02 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366 Aug 26 19:00:02 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:02 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.343s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:00:02 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2aa15084-ed92-4655-9ddf-f648bca8bc52 tempest-GroupSnapshotsTest-1520561909 None] Delete group completed successfully. Aug 26 19:00:02 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2031760504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3acb6f89d94147946bfb193a8a5fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:02Z,use_quota=True,user_id='53f0acf57f1e427cad32cde5fbc9ccb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Creating volume 5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:00:02 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:00:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42d6079-fdb2-4798-97c9-499448765c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb830c1-3b19-431c-9a08-c03d4b223366', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7a9869-94a2-4567-8224-452ece0b6ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:03 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 1073741824 Aug 26 19:00:03 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:03 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Volume volume-bdb830c1-3b19-431c-9a08-c03d4b223366 (bdb830c1-3b19-431c-9a08-c03d4b223366): created successfully Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7a9869-94a2-4567-8224-452ece0b6ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Flow 'volume_create_manager' (79819f99-c534-4d1c-b40e-d5ed6105252f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-43bb9cc5-8d38-4375-9e11-ad6af06c5239 tempest-TestServerVolumeAttachmentScenario-592292483 None] Created volume successfully. Aug 26 19:00:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-767df6a2-6540-4f39-bec6-797eeb16469d tempest-GroupSnapshotsTest-1520561909 None] Group tempest-GroupSnapshotsTest-Group-1881754782: creating Aug 26 19:00:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-767df6a2-6540-4f39-bec6-797eeb16469d tempest-GroupSnapshotsTest-1520561909 None] Group tempest-GroupSnapshotsTest-Group-1881754782: created successfully Aug 26 19:00:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-767df6a2-6540-4f39-bec6-797eeb16469d tempest-GroupSnapshotsTest-1520561909 None] Create group completed successfully. Aug 26 19:00:03 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 1073741824" returned: 0 in 0.684s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:03 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 Aug 26 19:00:03 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:03 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7" returned: 0 in 0.262s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2028aa-3a55-463f-ada6-b44b3c1787a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc301bd-680d-4eb9-9675-879ae1bc70ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:03 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Volume volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 (5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7): created successfully Aug 26 19:00:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc301bd-680d-4eb9-9675-879ae1bc70ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Flow 'volume_create_manager' (9b033890-436f-4b95-8319-a3c4ab24abc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:04 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-13078c33-1495-46eb-a985-c6c402db1131 tempest-TestServerVolumeAttachmentScenario-592292483 None] Created volume successfully. Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Flow 'volume_create_manager' (a9d82ac7-3514-4dc5-b781-25564cf6cb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e60766c-7129-4f55-a8f0-97fba0ca2147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e60766c-7129-4f55-a8f0-97fba0ca2147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358589591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1a129ff-3799-4c94-84d3-d8ddc264e2a6,host='devstack@QuobyteHD#QuobyteHD',id=0451bcba-d182-4ec4-97b2-d60f3674fa00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8454a1b96dd4440683690fd64de4cf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:05Z,use_quota=True,user_id='0e19333403034762814d2da460dc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5b8c07c-c323-40f9-8af1-372698a0fcee),volume_type_id=f5b8c07c-c323-40f9-8af1-372698a0fcee)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c163821-4c9e-4edb-9a2d-83196e626811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c163821-4c9e-4edb-9a2d-83196e626811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b181b3-0907-4638-96c0-ef838bd76dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b181b3-0907-4638-96c0-ef838bd76dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0451bcba-d182-4ec4-97b2-d60f3674fa00', 'volume_name': 'volume-0451bcba-d182-4ec4-97b2-d60f3674fa00', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80360f93-9050-4d35-9a88-50270b2c1c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80360f93-9050-4d35-9a88-50270b2c1c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc9e844-f117-47ce-a551-6c4ee348d79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:05 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Volume 0451bcba-d182-4ec4-97b2-d60f3674fa00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0451bcba-d182-4ec4-97b2-d60f3674fa00', 'volume_size': 1} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a1a129ff-3799-4c94-84d3-d8ddc264e2a6,created_at=2026-08-26T17:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358589591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1a129ff-3799-4c94-84d3-d8ddc264e2a6,host='devstack@QuobyteHD#QuobyteHD',id=0451bcba-d182-4ec4-97b2-d60f3674fa00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8454a1b96dd4440683690fd64de4cf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:05Z,use_quota=True,user_id='0e19333403034762814d2da460dc9ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5b8c07c-c323-40f9-8af1-372698a0fcee),volume_type_id=f5b8c07c-c323-40f9-8af1-372698a0fcee)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Creating volume 0451bcba-d182-4ec4-97b2-d60f3674fa00 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:00:05 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:00:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:05 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 1073741824 Aug 26 19:00:05 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:06 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 1073741824" returned: 0 in 0.634s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:06 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 Aug 26 19:00:06 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:06 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00" returned: 0 in 0.343s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:00:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc9e844-f117-47ce-a551-6c4ee348d79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0451bcba-d182-4ec4-97b2-d60f3674fa00', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9893d86-3ae8-40b6-b6f5-774d5b911bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:06 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Volume volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 (0451bcba-d182-4ec4-97b2-d60f3674fa00): created successfully Aug 26 19:00:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9893d86-3ae8-40b6-b6f5-774d5b911bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Flow 'volume_create_manager' (a9d82ac7-3514-4dc5-b781-25564cf6cb21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:06 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-6cc997e0-dbd6-4611-a6d0-85e42abcf02a tempest-GroupSnapshotsTest-1520561909 None] Created volume successfully. Aug 26 19:00:08 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] GroupSnapshot 85a62197-f04a-4412-917c-fad30e77a416: creating. Aug 26 19:00:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Group snapshot 85a62197-f04a-4412-917c-fad30e77a416: creating. {{(pid=93671) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 19:00:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Creating offline snapshot 0de25f0b-58cf-4f93-91ed-31fe29a26b53 of volume 0451bcba-d182-4ec4-97b2-d60f3674fa00 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:00:08 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cc8204-d417-44dd-b963-796288d813fb]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:00:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:08 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 Aug 26 19:00:08 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:08 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2b30ce95-bbbf-4725-8b76-24c9fb035f67 tempest-GroupsV320Test-1833450110 None] Group tempest-GroupsV320Test-Group-494661677: creating Aug 26 19:00:08 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2b30ce95-bbbf-4725-8b76-24c9fb035f67 tempest-GroupsV320Test-1833450110 None] Group tempest-GroupsV320Test-Group-494661677: created successfully Aug 26 19:00:08 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2b30ce95-bbbf-4725-8b76-24c9fb035f67 tempest-GroupsV320Test-1833450110 None] Create group completed successfully. Aug 26 19:00:08 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00" returned: 0 in 0.608s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:08 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 1G Aug 26 19:00:08 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:09 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 1G" returned: 0 in 0.596s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:09 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 Aug 26 19:00:09 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:09 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53" returned: 0 in 0.453s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:09 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 19:00:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:09 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 Aug 26 19:00:09 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:10 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53" returned: 0 in 0.449s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:10 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.info Aug 26 19:00:10 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] Created reservations ['6cd60a9c-0c90-4b93-9881-7480b26a6429'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:00:10 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.info" returned: 0 in 0.315s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:10 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:10 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.info Aug 26 19:00:10 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:10 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:00:10 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:11 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.info" returned: 0 in 0.331s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:11 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.898s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.347s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:00:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3abc175b-4f02-4124-8360-39112b9dcc4d tempest-GroupsV320Test-1833450110 None] Delete group completed successfully. Aug 26 19:00:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-192f077f-fd11-41ec-9ee0-bc22a87aebb1 tempest-GroupSnapshotsTest-1520561909 None] group_snapshot 85a62197-f04a-4412-917c-fad30e77a416: created successfully Aug 26 19:00:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] group_snapshot 85a62197-f04a-4412-917c-fad30e77a416: deleting Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] group_snapshot 85a62197-f04a-4412-917c-fad30e77a416: deleting {{(pid=93671) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-0451bcba-d182-4ec4-97b2-d60f3674fa00" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-0451bcba-d182-4ec4-97b2-d60f3674fa00" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-0de25f0b-58cf-4f93-91ed-31fe29a26b53" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-0de25f0b-58cf-4f93-91ed-31fe29a26b53" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Deleting offline snapshot 0de25f0b-58cf-4f93-91ed-31fe29a26b53 of volume 0451bcba-d182-4ec4-97b2-d60f3674fa00 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] snapshot_file for this snap is: volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe722b9f-0124-40f9-bccf-9b008909aa00]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:00:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:12 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 Aug 26 19:00:12 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:12 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53" returned: 0 in 0.547s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0451bcba-d182-4ec4-97b2-d60f3674fa00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:00:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c783793c-baee-495a-9b8d-163da760ddc9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:00:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:12 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 Aug 26 19:00:12 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:13 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00" returned: 0 in 1.008s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:13 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 Aug 26 19:00:13 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:14 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53" returned: 0 in 0.762s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:14 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53 Aug 26 19:00:14 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:14 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00.0de25f0b-58cf-4f93-91ed-31fe29a26b53" returned: 0 in 0.368s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-0de25f0b-58cf-4f93-91ed-31fe29a26b53" released by "_delete_snapshot" :: held 2.908s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:00:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-0451bcba-d182-4ec4-97b2-d60f3674fa00" released by "delete_snapshot" :: held 2.945s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:00:14 devstack cinder-volume[93671]: WARNING cinder.quota [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1662666450 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1662666450, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:00:14 devstack cinder-volume[93671]: WARNING cinder.quota [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1662666450 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1662666450, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:00:14 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['62bc858c-b34b-4e75-9b61-1f8bd311b239', '97b3bd95-16c2-422d-a416-070079e1537c', '4bf07317-b1c5-4706-aeb2-098dc1e96a4f', '167b683e-58a3-477f-b88b-ec13ea553fc1'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:00:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4415de13-7312-499c-aeaa-07866e8b45bf tempest-GroupSnapshotsTest-1520561909 None] group_snapshot 85a62197-f04a-4412-917c-fad30e77a416: deleted successfully Aug 26 19:00:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "cinder-quobyte-0451bcba-d182-4ec4-97b2-d60f3674fa00" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:00:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-0451bcba-d182-4ec4-97b2-d60f3674fa00" acquired by "delete_volume" :: waited 0.053s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:00:15 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f717414-3ece-49ab-89df-f1ebfac11026]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:00:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:16 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 Aug 26 19:00:16 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:16 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00" returned: 0 in 0.589s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:16 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00 Aug 26 19:00:16 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:16 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0451bcba-d182-4ec4-97b2-d60f3674fa00" returned: 0 in 0.481s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Lock "cinder-quobyte-0451bcba-d182-4ec4-97b2-d60f3674fa00" released by "delete_volume" :: held 1.221s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:00:17 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['00eec828-c752-493f-8619-a18cdb9923f3'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:00:17 devstack cinder-volume[93671]: WARNING cinder.quota [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1662666450 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1662666450, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:00:17 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Created reservations ['0cb209c2-dc01-4f2e-9ffb-f3df8cd2e0ba', 'cd32fd9f-6df3-44bd-9f91-3304a698a952', '74c421e9-3a4c-4eb8-b8f0-2b6049cf25d2', '514af36b-d610-4bd5-8f57-1134214f78b5'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:00:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:17 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:00:17 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:18 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.510s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:18 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:00:18 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4c1553e2-9a32-43ee-b2e8-65cb014811b7 tempest-GroupSnapshotsTest-1520561909 None] Delete group completed successfully. Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Flow 'volume_create_manager' (9b05a438-6ed4-4b2b-859e-7e0982a35b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d6df2e-6023-465b-b161-9527a1852239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d6df2e-6023-465b-b161-9527a1852239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-875316116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8576802f-93e8-43f0-bd7e-804b610c3af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019ba701ad0848548eec47295c8a97ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:26Z,use_quota=True,user_id='652d7ed0987840c5b9769703547acc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef054f2-bc49-42c6-abc6-865ec89632a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef054f2-bc49-42c6-abc6-865ec89632a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0202f808-f3ca-4b61-9fb1-671a5fa34c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0202f808-f3ca-4b61-9fb1-671a5fa34c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8576802f-93e8-43f0-bd7e-804b610c3af9', 'volume_name': 'volume-8576802f-93e8-43f0-bd7e-804b610c3af9', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b28b45-ffb9-440d-8b2b-78b19458871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b28b45-ffb9-440d-8b2b-78b19458871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efcd2ef-4e15-4089-8998-64020df1c531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:26 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Volume 8576802f-93e8-43f0-bd7e-804b610c3af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8576802f-93e8-43f0-bd7e-804b610c3af9', 'volume_size': 1} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-875316116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8576802f-93e8-43f0-bd7e-804b610c3af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019ba701ad0848548eec47295c8a97ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:26Z,use_quota=True,user_id='652d7ed0987840c5b9769703547acc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Creating volume 8576802f-93e8-43f0-bd7e-804b610c3af9 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:00:26 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:26 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9 1073741824 Aug 26 19:00:26 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:26 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9 1073741824" returned: 0 in 0.608s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:26 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9 Aug 26 19:00:26 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:27 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9" returned: 0 in 0.406s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:00:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efcd2ef-4e15-4089-8998-64020df1c531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8576802f-93e8-43f0-bd7e-804b610c3af9', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8843d129-ec19-4c33-8284-90f8040123e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:27 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Volume volume-8576802f-93e8-43f0-bd7e-804b610c3af9 (8576802f-93e8-43f0-bd7e-804b610c3af9): created successfully Aug 26 19:00:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8843d129-ec19-4c33-8284-90f8040123e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Flow 'volume_create_manager' (9b05a438-6ed4-4b2b-859e-7e0982a35b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:27 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-1b2a6cd4-2a91-4f76-b031-8bbb35658b95 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Created volume successfully. Aug 26 19:00:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Acquiring lock "cinder-8576802f-93e8-43f0-bd7e-804b610c3af9-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:00:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "cinder-8576802f-93e8-43f0-bd7e-804b610c3af9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:00:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Acquiring lock "cinder-quobyte-8576802f-93e8-43f0-bd7e-804b610c3af9" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:00:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "cinder-quobyte-8576802f-93e8-43f0-bd7e-804b610c3af9" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:00:28 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93b314c-5b60-4353-819b-76ed4156a8a0]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:00:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:28 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9 Aug 26 19:00:28 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:29 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9" returned: 0 in 0.633s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:29 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9 Aug 26 19:00:29 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:29 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8576802f-93e8-43f0-bd7e-804b610c3af9" returned: 0 in 0.453s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "cinder-quobyte-8576802f-93e8-43f0-bd7e-804b610c3af9" released by "delete_volume" :: held 1.176s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Created reservations ['a45d7190-6746-469d-b644-ff5f54591f75', '17590d93-79fa-4dd7-8ee3-d21123845f8e', 'f8db190c-6203-4e91-8b07-91fd385bdbb7', 'ed9ef4bb-8c46-49ed-8f6d-4173ee74dc6a'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:30 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:00:30 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:30 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.415s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:00:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Deleted volume successfully. Aug 26 19:00:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1855a69-0e3d-4ad5-9beb-be13b2e12315 tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "cinder-8576802f-93e8-43f0-bd7e-804b610c3af9-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:00:31 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Flow 'volume_create_manager' (27cddc48-9768-464e-bb82-92576cb24595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2804dc6b-68d8-40fb-b756-5a6ab6a0140c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2804dc6b-68d8-40fb-b756-5a6ab6a0140c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1744680782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3399ea-8b1f-49a0-822b-af20a3cc9113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019ba701ad0848548eec47295c8a97ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:32Z,use_quota=True,user_id='652d7ed0987840c5b9769703547acc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f8c9c8-ddb8-4ecf-bb96-3307b446dcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f8c9c8-ddb8-4ecf-bb96-3307b446dcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2aa77cc-c889-4097-9f5f-7aa9132d4ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2aa77cc-c889-4097-9f5f-7aa9132d4ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3399ea-8b1f-49a0-822b-af20a3cc9113', 'volume_name': 'volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a3a65c-b580-45d2-8e13-36b0d3caff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a3a65c-b580-45d2-8e13-36b0d3caff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12668096-4e65-492a-8d7d-1bf118606b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:32 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Volume bc3399ea-8b1f-49a0-822b-af20a3cc9113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113', 'volume_size': 1} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1744680782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3399ea-8b1f-49a0-822b-af20a3cc9113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019ba701ad0848548eec47295c8a97ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:32Z,use_quota=True,user_id='652d7ed0987840c5b9769703547acc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Creating volume bc3399ea-8b1f-49a0-822b-af20a3cc9113 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:00:32 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:32 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 1073741824 Aug 26 19:00:32 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:32 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 1073741824" returned: 0 in 0.701s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:32 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 Aug 26 19:00:32 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:33 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113" returned: 0 in 0.439s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:00:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12668096-4e65-492a-8d7d-1bf118606b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b749a552-ce31-493c-a7ac-0314b00419ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Volume volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 (bc3399ea-8b1f-49a0-822b-af20a3cc9113): created successfully Aug 26 19:00:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b749a552-ce31-493c-a7ac-0314b00419ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Flow 'volume_create_manager' (27cddc48-9768-464e-bb82-92576cb24595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b50c7fb5-e9a3-4af2-8e50-7ef52539e4cb tempest-VolumeQuotasAdminTestJSON-1218617568 None] Created volume successfully. Aug 26 19:00:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9301a2d9-d75d-4c67-bee2-d4a9d4aa96d7 tempest-VolumeQuotasAdminTestJSON-523513645 None] Transfer volume completed successfully. Aug 26 19:00:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Acquiring lock "cinder-bc3399ea-8b1f-49a0-822b-af20a3cc9113-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:00:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Lock "cinder-bc3399ea-8b1f-49a0-822b-af20a3cc9113-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:00:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Acquiring lock "cinder-quobyte-bc3399ea-8b1f-49a0-822b-af20a3cc9113" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:00:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Lock "cinder-quobyte-bc3399ea-8b1f-49a0-822b-af20a3cc9113" acquired by "delete_volume" :: waited 0.083s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:00:37 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[59228a3b-5163-4e17-9258-7c6978378534]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:00:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:37 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 Aug 26 19:00:37 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:38 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113" returned: 0 in 0.755s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:38 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113 Aug 26 19:00:38 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:38 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bc3399ea-8b1f-49a0-822b-af20a3cc9113" returned: 0 in 0.498s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Lock "cinder-quobyte-bc3399ea-8b1f-49a0-822b-af20a3cc9113" released by "delete_volume" :: held 1.418s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:00:38 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Created reservations ['321ec110-e7a9-4fa0-b2fe-0d8dcda5e84e', 'cb105cc6-9dc4-4075-8181-10cdf84a914d', '0f86bcbc-d2c9-4ce2-aedd-138fbb1a33c5', '258ba98f-6a7f-4dc4-8c84-77850699714b'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:00:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:39 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:00:39 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:39 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.396s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:39 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:00:39 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Deleted volume successfully. Aug 26 19:00:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-38ad2faf-fd49-4b5d-99c3-d86c0f6a285a tempest-VolumeQuotasAdminTestJSON-987050963 None] Lock "cinder-bc3399ea-8b1f-49a0-822b-af20a3cc9113-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:00:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d7966044-75e4-46a3-8c4a-ba6ea74020ce req-c0f82e95-5f51-4207-97e5-865d68210291 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d7966044-75e4-46a3-8c4a-ba6ea74020ce req-c0f82e95-5f51-4207-97e5-865d68210291 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d7966044-75e4-46a3-8c4a-ba6ea74020ce req-c0f82e95-5f51-4207-97e5-865d68210291 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-d7966044-75e4-46a3-8c4a-ba6ea74020ce req-c0f82e95-5f51-4207-97e5-865d68210291 tempest-TestServerVolumeAttachmentScenario-592292483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-bdb830c1-3b19-431c-9a08-c03d4b223366', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3977d938-ca1d-4ca8-96dc-2b999de3a1e4', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:00:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-d7966044-75e4-46a3-8c4a-ba6ea74020ce req-c0f82e95-5f51-4207-97e5-865d68210291 tempest-TestServerVolumeAttachmentScenario-592292483 None] attachment_update completed successfully. Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=127,cinder:INSERT=32,cinder:UPDATE=128,cinder:DELETE=3 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=138,cinder:SELECT=111,cinder:INSERT=30,cinder:DELETE=8 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Flow 'volume_create_manager' (5b8635d6-16a7-413f-ad3c-7931eab3d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff05fbf-81b8-4855-bcfc-1c06a93e5e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff05fbf-81b8-4855-bcfc-1c06a93e5e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-213858774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773c9550-82e5-4bf6-993a-53377e11c63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d800fd5b8c5e404ba9352a0e5b0c9825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:54Z,use_quota=True,user_id='7e6723711476410a8c01db9679c930db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7829218a-e66e-415e-be79-889f77e8ea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7829218a-e66e-415e-be79-889f77e8ea09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec605dfa-115b-420a-8cb5-9930762522cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec605dfa-115b-420a-8cb5-9930762522cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773c9550-82e5-4bf6-993a-53377e11c63c', 'volume_name': 'volume-773c9550-82e5-4bf6-993a-53377e11c63c', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995c76fc-08a4-4407-b17e-7c92ce5be593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995c76fc-08a4-4407-b17e-7c92ce5be593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e7b09a-54df-41c5-a55a-422181cbc98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:53 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Volume 773c9550-82e5-4bf6-993a-53377e11c63c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773c9550-82e5-4bf6-993a-53377e11c63c', 'volume_size': 1} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-213858774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773c9550-82e5-4bf6-993a-53377e11c63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d800fd5b8c5e404ba9352a0e5b0c9825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:54Z,use_quota=True,user_id='7e6723711476410a8c01db9679c930db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Creating volume 773c9550-82e5-4bf6-993a-53377e11c63c {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:00:53 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:00:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:53 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c 1073741824 Aug 26 19:00:53 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:54 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:00:54 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:54 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c 1073741824" returned: 0 in 0.864s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:54 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c Aug 26 19:00:54 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:54 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.423s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:00:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:00:55 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c" returned: 0 in 0.409s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:00:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e7b09a-54df-41c5-a55a-422181cbc98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773c9550-82e5-4bf6-993a-53377e11c63c', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55d48a2-b2f9-455d-ab9f-8bc4c5a736d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:55 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Volume volume-773c9550-82e5-4bf6-993a-53377e11c63c (773c9550-82e5-4bf6-993a-53377e11c63c): created successfully Aug 26 19:00:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55d48a2-b2f9-455d-ab9f-8bc4c5a736d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Flow 'volume_create_manager' (5b8635d6-16a7-413f-ad3c-7931eab3d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7629c215-9707-4c15-b648-e48f7e384bd4 tempest-ServerRescueNegativeTestJSON-1770530451 None] Created volume successfully. Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Flow 'volume_create_manager' (ce8dd5ad-6dd5-4716-947f-8e7bad8a2c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab4daa1-f2fe-4000-8727-695b6f57c804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab4daa1-f2fe-4000-8727-695b6f57c804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1928778926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70434289-14f6-45d4-82fd-c2224401144f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bcde43860e43ed87bb4406f77d9bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:56Z,use_quota=True,user_id='d8348ab708db4e96862ff1fe98521654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1933a094-102f-43f6-aa3f-986669926839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1933a094-102f-43f6-aa3f-986669926839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07532bcc-7f94-420c-b24d-6838d4c5a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07532bcc-7f94-420c-b24d-6838d4c5a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70434289-14f6-45d4-82fd-c2224401144f', 'volume_name': 'volume-70434289-14f6-45d4-82fd-c2224401144f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fffc19f-4bbc-42f6-96c9-35201413080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fffc19f-4bbc-42f6-96c9-35201413080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1348a0a0-62f8-4299-9274-945486e86242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:56 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Volume 70434289-14f6-45d4-82fd-c2224401144f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70434289-14f6-45d4-82fd-c2224401144f', 'volume_size': 1} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1928778926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70434289-14f6-45d4-82fd-c2224401144f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4bcde43860e43ed87bb4406f77d9bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:00:56Z,use_quota=True,user_id='d8348ab708db4e96862ff1fe98521654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Creating volume 70434289-14f6-45d4-82fd-c2224401144f {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:00:56 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:00:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:56 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f 1073741824 Aug 26 19:00:56 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:57 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f 1073741824" returned: 0 in 0.824s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:00:57 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f Aug 26 19:00:57 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:00:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-da6a2f4a-4173-463f-8936-54fb65f5825e req-c9bfc374-f9c6-409a-a1f3-24e7c6f5f7c2 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:00:57 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Aug 26 19:00:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f" returned: 0 in 0.459s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:00:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:00:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-da6a2f4a-4173-463f-8936-54fb65f5825e req-c9bfc374-f9c6-409a-a1f3-24e7c6f5f7c2 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.077s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:00:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-da6a2f4a-4173-463f-8936-54fb65f5825e req-c9bfc374-f9c6-409a-a1f3-24e7c6f5f7c2 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:00:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1348a0a0-62f8-4299-9274-945486e86242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70434289-14f6-45d4-82fd-c2224401144f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4f8ca0-6149-4967-a352-7547372635f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:00:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-da6a2f4a-4173-463f-8936-54fb65f5825e req-c9bfc374-f9c6-409a-a1f3-24e7c6f5f7c2 tempest-TestServerVolumeAttachmentScenario-592292483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d3100b2-ce5c-4e82-b7bf-ac64cd722bc1', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:00:58 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Volume volume-70434289-14f6-45d4-82fd-c2224401144f (70434289-14f6-45d4-82fd-c2224401144f): created successfully Aug 26 19:00:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4f8ca0-6149-4967-a352-7547372635f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:00:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Flow 'volume_create_manager' (ce8dd5ad-6dd5-4716-947f-8e7bad8a2c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:00:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-007d9679-983f-48e6-85b3-0a05ae764452 tempest-VolumesServicesTestJSON-263763384 None] Created volume successfully. Aug 26 19:00:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-da6a2f4a-4173-463f-8936-54fb65f5825e req-c9bfc374-f9c6-409a-a1f3-24e7c6f5f7c2 tempest-TestServerVolumeAttachmentScenario-592292483 None] attachment_update completed successfully. Aug 26 19:01:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Acquiring lock "cinder-70434289-14f6-45d4-82fd-c2224401144f-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Lock "cinder-70434289-14f6-45d4-82fd-c2224401144f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Acquiring lock "cinder-quobyte-70434289-14f6-45d4-82fd-c2224401144f" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Lock "cinder-quobyte-70434289-14f6-45d4-82fd-c2224401144f" acquired by "delete_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:00 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[659955e3-1561-4d2d-9bd9-1ca072020abc]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:01:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:00 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f Aug 26 19:01:00 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:00 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f" returned: 0 in 0.635s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:00 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f Aug 26 19:01:00 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:01 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-70434289-14f6-45d4-82fd-c2224401144f" returned: 0 in 0.469s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Lock "cinder-quobyte-70434289-14f6-45d4-82fd-c2224401144f" released by "delete_volume" :: held 1.176s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:01 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Created reservations ['7ba7fc15-431a-4908-964c-ba319d08c1cb', '1e81d4a0-27bc-4c7d-aa9d-1fc1b42e962d', '7c24f406-1a00-4676-aa03-1746e20fb24d', '55ab68f7-a489-49f7-bc8d-18cc0b7e1c21'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:01:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:01:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:01:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:01:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:01:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:01:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:01 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:01:01 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:02 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.558s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:02 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:01:02 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Deleted volume successfully. Aug 26 19:01:02 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4eaea4c0-d51d-408b-99c1-87dc33afd3de tempest-VolumesServicesTestJSON-263763384 None] Lock "cinder-70434289-14f6-45d4-82fd-c2224401144f-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-feb9c956-f775-41bc-ac27-a0fc7220b9d4 req-81fc8744-a7c6-43f9-81e3-d09e2b3aaffb tempest-TestServerVolumeAttachmentScenario-592292483 None] Terminate volume connection completed successfully. Aug 26 19:01:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-feb9c956-f775-41bc-ac27-a0fc7220b9d4 req-81fc8744-a7c6-43f9-81e3-d09e2b3aaffb tempest-TestServerVolumeAttachmentScenario-592292483 None] Deleting attachment 9d3100b2-ce5c-4e82-b7bf-ac64cd722bc1. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:01:06 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-4cd7620b-fdfe-4dcd-ba5b-9cb5cdc47214 req-588c0f52-c03e-44d4-8435-32b59f90cd35 tempest-TestServerVolumeAttachmentScenario-592292483 None] Terminate volume connection completed successfully. Aug 26 19:01:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-4cd7620b-fdfe-4dcd-ba5b-9cb5cdc47214 req-588c0f52-c03e-44d4-8435-32b59f90cd35 tempest-TestServerVolumeAttachmentScenario-592292483 None] Deleting attachment 3977d938-ca1d-4ca8-96dc-2b999de3a1e4. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:01:13 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=12,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:01:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Acquiring lock "cinder-773c9550-82e5-4bf6-993a-53377e11c63c-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "cinder-773c9550-82e5-4bf6-993a-53377e11c63c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Acquiring lock "cinder-quobyte-773c9550-82e5-4bf6-993a-53377e11c63c" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "cinder-quobyte-773c9550-82e5-4bf6-993a-53377e11c63c" acquired by "delete_volume" :: waited 0.038s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:13 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ce1bdc-d5e8-4cf9-82d3-6988f3dcdefb]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:01:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:13 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c Aug 26 19:01:13 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "cinder-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:13 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "cinder-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c" returned: 0 in 0.691s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:14 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c Aug 26 19:01:14 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "cinder-quobyte-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "cinder-quobyte-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a36ab5-eaa6-4218-9b5d-2ed6818e63d7]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:14 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 Aug 26 19:01:14 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:14 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-773c9550-82e5-4bf6-993a-53377e11c63c" returned: 0 in 0.456s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "cinder-quobyte-773c9550-82e5-4bf6-993a-53377e11c63c" released by "delete_volume" :: held 1.221s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Created reservations ['7701195e-5e19-4292-9932-232dee70a0d8', 'b48aa207-5d5e-456c-80f0-eefc7373eb9c', '3deb5d43-a432-47e7-ae3d-f8d38625596e', 'e4f5fb41-3aad-4a9e-a7c1-92900f538d95'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:01:14 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7" returned: 0 in 0.607s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:14 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:01:14 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:14 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7 Aug 26 19:01:14 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:15 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.355s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:01:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Deleted volume successfully. Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d3695b3b-4394-4905-9aa0-421adac383c6 tempest-ServerRescueNegativeTestJSON-1770530451 None] Lock "cinder-773c9550-82e5-4bf6-993a-53377e11c63c-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:15 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7" returned: 0 in 0.465s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "cinder-quobyte-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7" released by "delete_volume" :: held 1.141s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Created reservations ['c6f7dbf0-7ec5-45fb-905e-d4804ef41c25', 'ff077a3b-ae8c-451b-b148-25768a1e3613', 'eba8ba14-ea89-4894-8cd0-95ffdef9c5b6', 'd23d6045-c8b1-44fc-a9eb-3e15d00ae317'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:15 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:01:15 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:15 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.468s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:01:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Deleted volume successfully. Aug 26 19:01:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b244fc63-bd65-4e19-a706-66854ca77419 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "cinder-5f7066ce-8ca2-40e0-a6eb-c6acd5b596b7-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "cinder-bdb830c1-3b19-431c-9a08-c03d4b223366-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "cinder-bdb830c1-3b19-431c-9a08-c03d4b223366-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "cinder-quobyte-bdb830c1-3b19-431c-9a08-c03d4b223366" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "cinder-quobyte-bdb830c1-3b19-431c-9a08-c03d4b223366" acquired by "delete_volume" :: waited 0.039s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[922fd8b2-5c97-4892-a679-25f272db44af]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:01:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:17 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366 Aug 26 19:01:17 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:17 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366" returned: 0 in 0.748s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:17 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366 Aug 26 19:01:17 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:18 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bdb830c1-3b19-431c-9a08-c03d4b223366" returned: 0 in 0.608s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "cinder-quobyte-bdb830c1-3b19-431c-9a08-c03d4b223366" released by "delete_volume" :: held 1.452s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Created reservations ['c1ff8634-51d1-4df6-ab85-0ce0d7d3b61f', 'e6331710-9e05-4890-94c9-f97eb17dcaa2', '47a23a60-b9b5-4fa5-bdba-9406de9af8c6', 'dffa965d-7e9e-4665-b71d-0ca997591465'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:18 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:01:18 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:18 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.473s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:18 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:01:18 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Deleted volume successfully. Aug 26 19:01:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7625b6d-b4bb-4049-89b6-06b9267e4643 tempest-TestServerVolumeAttachmentScenario-592292483 None] Lock "cinder-bdb830c1-3b19-431c-9a08-c03d4b223366-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:28 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=39,cinder:INSERT=12,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:01:28 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=13,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Flow 'volume_create_manager' (d97beea9-27f6-4b48-b0f4-5eefda2ca041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b4177a-6a33-4cf9-8fc5-927667193920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b4177a-6a33-4cf9-8fc5-927667193920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-129420758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718aafcf-9575-4bbd-a0c5-845d960aed06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eedb717af75d43c3bb2b1063737c60bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:01:43Z,use_quota=True,user_id='18b4815a34344e2783db98d8407ea918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1e1840-f012-4668-ac63-aa4659bc1e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1e1840-f012-4668-ac63-aa4659bc1e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139ad065-2776-4a65-ae5d-ce1cf9c4c533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139ad065-2776-4a65-ae5d-ce1cf9c4c533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '718aafcf-9575-4bbd-a0c5-845d960aed06', 'volume_name': 'volume-718aafcf-9575-4bbd-a0c5-845d960aed06', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d760f5a1-e7f5-44fc-9737-539a94053f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d760f5a1-e7f5-44fc-9737-539a94053f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddddd499-e304-44f5-9a60-dd776ce899a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:01:43 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Volume 718aafcf-9575-4bbd-a0c5-845d960aed06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-718aafcf-9575-4bbd-a0c5-845d960aed06', 'volume_size': 1} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-129420758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718aafcf-9575-4bbd-a0c5-845d960aed06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eedb717af75d43c3bb2b1063737c60bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:01:43Z,use_quota=True,user_id='18b4815a34344e2783db98d8407ea918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Creating volume 718aafcf-9575-4bbd-a0c5-845d960aed06 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:01:43 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:01:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:43 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06 1073741824 Aug 26 19:01:43 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:44 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06 1073741824" returned: 0 in 0.610s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:44 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06 Aug 26 19:01:44 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:44 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06" returned: 0 in 0.422s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:01:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:01:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddddd499-e304-44f5-9a60-dd776ce899a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718aafcf-9575-4bbd-a0c5-845d960aed06', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:01:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66544779-3351-44b4-ae7b-9acfe1e26860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:01:44 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Volume volume-718aafcf-9575-4bbd-a0c5-845d960aed06 (718aafcf-9575-4bbd-a0c5-845d960aed06): created successfully Aug 26 19:01:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66544779-3351-44b4-ae7b-9acfe1e26860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:01:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Flow 'volume_create_manager' (d97beea9-27f6-4b48-b0f4-5eefda2ca041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:01:44 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2a3702df-2b5f-425a-8dc6-b3bb10becde0 tempest-AbsoluteLimitsTests-39104295 None] Created volume successfully. Aug 26 19:01:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Acquiring lock "cinder-718aafcf-9575-4bbd-a0c5-845d960aed06-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Lock "cinder-718aafcf-9575-4bbd-a0c5-845d960aed06-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Acquiring lock "cinder-quobyte-718aafcf-9575-4bbd-a0c5-845d960aed06" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:01:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Lock "cinder-quobyte-718aafcf-9575-4bbd-a0c5-845d960aed06" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:01:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[50748d77-0e20-4841-a7fb-ddc730883037]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:01:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:46 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06 Aug 26 19:01:46 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:46 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06" returned: 0 in 0.455s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:46 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06 Aug 26 19:01:46 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:46 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-718aafcf-9575-4bbd-a0c5-845d960aed06" returned: 0 in 0.430s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Lock "cinder-quobyte-718aafcf-9575-4bbd-a0c5-845d960aed06" released by "delete_volume" :: held 0.969s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Created reservations ['98b968fe-b9d8-484d-832f-86e7fec43f2c', '13f7a613-b508-4e1d-9beb-297f4c2631f3', 'c0017834-d5a6-49c0-92b5-664aa3910b29', '700ee604-9d16-4ac3-a773-4d0243158ba7'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:47 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:01:47 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:47 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.302s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:01:47 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Deleted volume successfully. Aug 26 19:01:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5eba878a-dd15-496b-b43b-1d34d0b77d7e tempest-AbsoluteLimitsTests-39104295 None] Lock "cinder-718aafcf-9575-4bbd-a0c5-845d960aed06-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:01:54 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:01:54 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:01:54 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.348s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:01:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:01:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:01:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Flow 'volume_create_manager' (ab88c50e-8b26-4a0b-91ae-9a80a1199c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c154129-f3f6-40f9-82bc-f823f379b363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c154129-f3f6-40f9-82bc-f823f379b363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-742033847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e213afe2-e750-41fc-a320-7187c760a91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051cf95f829f4ba89a35bc9add7a68cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:01Z,use_quota=True,user_id='75cd81b24a6f4ea68660f7c705bd30ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89561f37-dcd9-4944-bb27-4e1b6db0b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89561f37-dcd9-4944-bb27-4e1b6db0b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f1836c-e8b3-4da9-a087-cac9744776cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f1836c-e8b3-4da9-a087-cac9744776cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e213afe2-e750-41fc-a320-7187c760a91d', 'volume_name': 'volume-e213afe2-e750-41fc-a320-7187c760a91d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389667b7-efeb-42c3-a6ff-2a120f1b9f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389667b7-efeb-42c3-a6ff-2a120f1b9f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c1c48b-24da-455a-ba63-bcc8746aa8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:01 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Volume e213afe2-e750-41fc-a320-7187c760a91d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e213afe2-e750-41fc-a320-7187c760a91d', 'volume_size': 1} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-742033847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e213afe2-e750-41fc-a320-7187c760a91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051cf95f829f4ba89a35bc9add7a68cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:01Z,use_quota=True,user_id='75cd81b24a6f4ea68660f7c705bd30ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Creating volume e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:01 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:01 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d 1073741824 Aug 26 19:02:01 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:02 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d 1073741824" returned: 0 in 1.096s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:02 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d Aug 26 19:02:02 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:03 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d" returned: 0 in 0.614s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c1c48b-24da-455a-ba63-bcc8746aa8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e213afe2-e750-41fc-a320-7187c760a91d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec85e95-01ac-4db8-b152-2c97efb73acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:03 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Volume volume-e213afe2-e750-41fc-a320-7187c760a91d (e213afe2-e750-41fc-a320-7187c760a91d): created successfully Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec85e95-01ac-4db8-b152-2c97efb73acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Flow 'volume_create_manager' (ab88c50e-8b26-4a0b-91ae-9a80a1199c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-47f4935a-7ca2-416e-b2fa-6996b2fdad19 tempest-VolumesDeleteCascade-1040361476 None] Created volume successfully. Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Creating offline snapshot 3045cd82-0e16-4589-81ac-9f98ea9eef2a of volume e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e721a5-1064-4d76-b311-062fb5f49fee]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:04 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d Aug 26 19:02:04 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:04 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d" returned: 0 in 0.723s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:04 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a 1G Aug 26 19:02:04 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:05 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a 1G" returned: 0 in 0.936s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e213afe2-e750-41fc-a320-7187c760a91d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:05 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e213afe2-e750-41fc-a320-7187c760a91d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a Aug 26 19:02:05 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:05 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e213afe2-e750-41fc-a320-7187c760a91d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a" returned: 0 in 0.438s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:05 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a is being set with open permissions: ugo+rw Aug 26 19:02:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:05 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a Aug 26 19:02:05 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:06 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a" returned: 0 in 0.400s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:06 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.info Aug 26 19:02:06 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:06 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.info" returned: 0 in 0.401s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:06 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.info is being set with open permissions: ugo+rw Aug 26 19:02:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:06 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.info Aug 26 19:02:06 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:07 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.info" returned: 0 in 0.356s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.448s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:07 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-593fe14f-494a-4369-8da6-9e800e55e3a6 tempest-VolumesDeleteCascade-1040361476 None] Create snapshot completed successfully Aug 26 19:02:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Creating offline snapshot 5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 of volume e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:02:08 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ca1d11-a482-4218-9526-1c44ca8f0224]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:08 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a Aug 26 19:02:08 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:09 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a" returned: 0 in 0.822s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e213afe2-e750-41fc-a320-7187c760a91d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:02:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:09 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 1G Aug 26 19:02:09 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (dda0550d-3859-4efa-a33b-ae7a85cb5189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d7a065-c224-44d6-9326-e278ab2174e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d7a065-c224-44d6-9326-e278ab2174e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-478475867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3671b64d-8ebd-47fd-b681-07e1ee2ee865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:10Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eebb767-72e1-4e57-887c-b4e9912a63e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eebb767-72e1-4e57-887c-b4e9912a63e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cd5777-2697-4525-bd79-8cdb68f4170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cd5777-2697-4525-bd79-8cdb68f4170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3671b64d-8ebd-47fd-b681-07e1ee2ee865', 'volume_name': 'volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0e69cf-e326-4f69-8412-1c5d6dee6fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0e69cf-e326-4f69-8412-1c5d6dee6fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ff9a4c-62e7-43db-90e1-8262dd867fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:10 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Volume 3671b64d-8ebd-47fd-b681-07e1ee2ee865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865', 'volume_size': 1} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:10 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 1G" returned: 0 in 1.032s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:10 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 Aug 26 19:02:10 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:10 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0" returned: 0 in 0.494s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:10 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 is being set with open permissions: ugo+rw Aug 26 19:02:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:10 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 Aug 26 19:02:10 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:11 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0" returned: 0 in 0.484s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.133s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-478475867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3671b64d-8ebd-47fd-b681-07e1ee2ee865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:10Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Creating volume 3671b64d-8ebd-47fd-b681-07e1ee2ee865 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:11 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a45d3a3a-4268-4102-9890-805ebfe8205c tempest-VolumesDeleteCascade-1040361476 None] Create snapshot completed successfully Aug 26 19:02:11 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 1073741824 Aug 26 19:02:11 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:12 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 1073741824" returned: 0 in 1.393s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-e213afe2-e750-41fc-a320-7187c760a91d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-e213afe2-e750-41fc-a320-7187c760a91d-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:13 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 Aug 26 19:02:13 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Performing cascade delete. {{(pid=93671) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-3045cd82-0e16-4589-81ac-9f98ea9eef2a-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-3045cd82-0e16-4589-81ac-9f98ea9eef2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-e213afe2-e750-41fc-a320-7187c760a91d" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-e213afe2-e750-41fc-a320-7187c760a91d" acquired by "delete_snapshot" :: waited 0.048s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-3045cd82-0e16-4589-81ac-9f98ea9eef2a" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-3045cd82-0e16-4589-81ac-9f98ea9eef2a" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Deleting offline snapshot 3045cd82-0e16-4589-81ac-9f98ea9eef2a of volume e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:02:13 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] snapshot_file for this snap is: volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865" returned: 0 in 0.589s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a243f-2327-448e-9d1f-e0403c68c253]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ff9a4c-62e7-43db-90e1-8262dd867fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b541ca8b-b20d-4663-b8f1-85405fdca198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Volume volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 (3671b64d-8ebd-47fd-b681-07e1ee2ee865): created successfully Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b541ca8b-b20d-4663-b8f1-85405fdca198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (dda0550d-3859-4efa-a33b-ae7a85cb5189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-875650ee-b30c-4ea9-a7df-8e07547c728c tempest-VolumesActionsTest-856381984 None] Created volume successfully. Aug 26 19:02:13 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a Aug 26 19:02:13 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:14 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a" returned: 0 in 0.792s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e213afe2-e750-41fc-a320-7187c760a91d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:02:14 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4f89ec-4ce2-468d-ae0f-f6203882c9f2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:14 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d Aug 26 19:02:14 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-24b70c30-b761-4a5b-b999-4eff49460ba2 tempest-VolumesActionsTest-856381984 None] Acquiring lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865" by "attach_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-24b70c30-b761-4a5b-b999-4eff49460ba2 tempest-VolumesActionsTest-856381984 None] Lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865" acquired by "attach_volume" :: waited 0.053s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:15 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d" returned: 0 in 0.652s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:15 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bbe713-e13f-438d-85dd-417beebf939c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-24b70c30-b761-4a5b-b999-4eff49460ba2 tempest-VolumesActionsTest-856381984 None] Attaching volume 3671b64d-8ebd-47fd-b681-07e1ee2ee865 to instance 53e8f6a5-0e74-426e-8a98-a452ff4104c8 at mountpoint /dev/vdb on host None. Aug 26 19:02:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-24b70c30-b761-4a5b-b999-4eff49460ba2 tempest-VolumesActionsTest-856381984 None] Attach volume completed successfully. Aug 26 19:02:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-24b70c30-b761-4a5b-b999-4eff49460ba2 tempest-VolumesActionsTest-856381984 None] Lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865" released by "attach_volume" :: held 0.354s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:15 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 Aug 26 19:02:15 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:16 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0" returned: 0 in 1.151s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e213afe2-e750-41fc-a320-7187c760a91d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:02:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30a2937-3c40-474d-9fbd-ecaff41a3402]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:16 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a Aug 26 19:02:16 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4b5c615d-5d1e-46b7-bda5-b2656779050a tempest-VolumesActionsTest-76283468 None] Terminate volume connection completed successfully. Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4b5c615d-5d1e-46b7-bda5-b2656779050a tempest-VolumesActionsTest-76283468 None] Acquiring lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865-detach_volume" by "detach_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4b5c615d-5d1e-46b7-bda5-b2656779050a tempest-VolumesActionsTest-76283468 None] Lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4b5c615d-5d1e-46b7-bda5-b2656779050a tempest-VolumesActionsTest-76283468 None] Detaching volume 3671b64d-8ebd-47fd-b681-07e1ee2ee865 from instance 53e8f6a5-0e74-426e-8a98-a452ff4104c8. Aug 26 19:02:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4b5c615d-5d1e-46b7-bda5-b2656779050a tempest-VolumesActionsTest-76283468 None] Detach volume completed successfully. Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4b5c615d-5d1e-46b7-bda5-b2656779050a tempest-VolumesActionsTest-76283468 None] Lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:17 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a" returned: 0 in 0.980s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e213afe2-e750-41fc-a320-7187c760a91d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe0df0-000f-4dfd-b8be-2083cf26dd91]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f700c0e1-b125-4157-aa9b-90db6c90ce5a tempest-VolumesActionsTest-856381984 None] Acquiring lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865-detach_volume" by "detach_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f700c0e1-b125-4157-aa9b-90db6c90ce5a tempest-VolumesActionsTest-856381984 None] Lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f700c0e1-b125-4157-aa9b-90db6c90ce5a tempest-VolumesActionsTest-856381984 None] Volume detach called, but volume not attached. Aug 26 19:02:17 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d Aug 26 19:02:17 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f700c0e1-b125-4157-aa9b-90db6c90ce5a tempest-VolumesActionsTest-856381984 None] Lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Acquiring lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:18 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d" returned: 0 in 0.902s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Acquiring lock "cinder-quobyte-3671b64d-8ebd-47fd-b681-07e1ee2ee865" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:18 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a Aug 26 19:02:18 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Lock "cinder-quobyte-3671b64d-8ebd-47fd-b681-07e1ee2ee865" acquired by "delete_volume" :: waited 0.059s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:18 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[66832500-976f-484b-a33d-ffa7f288bd7b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:18 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 Aug 26 19:02:18 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:19 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a" returned: 0 in 0.699s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:19 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a Aug 26 19:02:19 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:19 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865" returned: 0 in 0.825s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:19 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.3045cd82-0e16-4589-81ac-9f98ea9eef2a" returned: 0 in 0.352s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e213afe2-e750-41fc-a320-7187c760a91d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 -F qcow2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:19 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865 Aug 26 19:02:19 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:19 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e213afe2-e750-41fc-a320-7187c760a91d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 -F qcow2 Aug 26 19:02:19 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:19 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3671b64d-8ebd-47fd-b681-07e1ee2ee865" returned: 0 in 0.512s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Lock "cinder-quobyte-3671b64d-8ebd-47fd-b681-07e1ee2ee865" released by "delete_volume" :: held 1.458s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:19 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e213afe2-e750-41fc-a320-7187c760a91d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 -F qcow2" returned: 0 in 0.527s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-3045cd82-0e16-4589-81ac-9f98ea9eef2a" released by "_delete_snapshot" :: held 6.391s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-e213afe2-e750-41fc-a320-7187c760a91d" released by "delete_snapshot" :: held 6.481s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Created reservations ['9afc58c7-ec9c-4fbf-88a1-7ccb96a5bfe5', 'dc156d39-d23b-484a-9dde-4e42b65afae7', '018754fd-3238-42d2-bfd9-51565a9e2a1d', 'a15eb7d7-a930-4d36-bdf3-7c3207ada6b9'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Created reservations ['1f75e48d-fa5b-42e4-9131-8f7eb2137ce5', '31efe714-65b0-44fd-a127-2c6e6a6eac41', 'ce15b8ce-4cd3-4b25-be00-62bde7378fd0', '85d76550-15f2-41e1-babe-6f1c4a156b0d'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:20 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:20 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:20 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Delete snapshot completed successfully. Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-3045cd82-0e16-4589-81ac-9f98ea9eef2a-delete_snapshot" released by "delete_snapshot" :: held 6.926s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-5fe8deb4-9b3b-4641-a29a-b11d3847ebe0-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-5fe8deb4-9b3b-4641-a29a-b11d3847ebe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-e213afe2-e750-41fc-a320-7187c760a91d" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-e213afe2-e750-41fc-a320-7187c760a91d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-5fe8deb4-9b3b-4641-a29a-b11d3847ebe0" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-5fe8deb4-9b3b-4641-a29a-b11d3847ebe0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Deleting offline snapshot 5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 of volume e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] snapshot_file for this snap is: volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b467e17e-e059-4d49-adb6-cdae4d5822aa]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:20 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 Aug 26 19:02:20 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:20 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.699s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:20 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Deleted volume successfully. Aug 26 19:02:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-6ee66112-d9e8-44d4-ae85-43b8c4d91c92 tempest-VolumesActionsTest-856381984 None] Lock "cinder-3671b64d-8ebd-47fd-b681-07e1ee2ee865-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:21 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0" returned: 0 in 0.905s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e213afe2-e750-41fc-a320-7187c760a91d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:02:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[69321e9f-f81c-4230-922d-7a71cf14701f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:21 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d Aug 26 19:02:21 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:22 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d" returned: 0 in 0.941s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:22 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 Aug 26 19:02:22 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:23 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0" returned: 0 in 0.803s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:23 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0 Aug 26 19:02:23 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:23 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d.5fe8deb4-9b3b-4641-a29a-b11d3847ebe0" returned: 0 in 0.690s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-5fe8deb4-9b3b-4641-a29a-b11d3847ebe0" released by "_delete_snapshot" :: held 3.565s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-e213afe2-e750-41fc-a320-7187c760a91d" released by "delete_snapshot" :: held 3.604s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:24 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Created reservations ['d80bed88-c533-4bb4-b509-71c23d263987', '8a302404-9295-40f7-b1f2-4fe296e642e1', 'f6ba3fcd-7571-4c24-ab3e-8bf1c154233e', 'dc6d2f56-ca6c-46a2-94b5-5bfe24ae8c49'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:24 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Delete snapshot completed successfully. Aug 26 19:02:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-5fe8deb4-9b3b-4641-a29a-b11d3847ebe0-delete_snapshot" released by "delete_snapshot" :: held 3.979s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Snapshots deleted, issuing volume delete {{(pid=93671) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 19:02:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-e213afe2-e750-41fc-a320-7187c760a91d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-e213afe2-e750-41fc-a320-7187c760a91d" acquired by "delete_volume" :: waited 0.045s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:24 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[034f7da4-b6a1-4d27-8ec0-0b0a207317fb]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:25 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d Aug 26 19:02:25 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:25 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d" returned: 0 in 1.012s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:25 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d Aug 26 19:02:25 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:25 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e213afe2-e750-41fc-a320-7187c760a91d" returned: 0 in 0.344s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-e213afe2-e750-41fc-a320-7187c760a91d" released by "delete_volume" :: held 1.527s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Created reservations ['6fc4621b-3a03-4383-a029-a9c2778c326e', 'cc7dc1a7-9614-445e-81f2-98cea0c4b5ee', 'b3e00017-47c3-4a67-bf32-5c6b741bcf99', 'c153e01b-3431-4a77-a998-529c297c27cd'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:26 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:26 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:26 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.418s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Deleted volume successfully. Aug 26 19:02:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88f6563a-3d33-44ef-a48c-0cfe4c259e78 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-e213afe2-e750-41fc-a320-7187c760a91d-delete_volume" released by "delete_volume" :: held 13.488s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Flow 'volume_create_manager' (c64a193a-8536-49ed-a3fa-7114ab1e9582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2dd1a7-1c99-406e-b5b2-8eabe7f9b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2dd1a7-1c99-406e-b5b2-8eabe7f9b888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-980725118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5ff1a0-427d-4270-9e47-e765e8b71887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051cf95f829f4ba89a35bc9add7a68cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:27Z,use_quota=True,user_id='75cd81b24a6f4ea68660f7c705bd30ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0da0f2a-3e15-42b8-b50c-b83b0d48a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0da0f2a-3e15-42b8-b50c-b83b0d48a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335eb423-caee-4c87-9413-95a71aa5212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335eb423-caee-4c87-9413-95a71aa5212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a5ff1a0-427d-4270-9e47-e765e8b71887', 'volume_name': 'volume-5a5ff1a0-427d-4270-9e47-e765e8b71887', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1ba7f5-ca00-44a5-bf18-941e8807e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1ba7f5-ca00-44a5-bf18-941e8807e801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3615943b-b605-4d18-97d9-c821b6126ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:27 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Volume 5a5ff1a0-427d-4270-9e47-e765e8b71887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a5ff1a0-427d-4270-9e47-e765e8b71887', 'volume_size': 1} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-980725118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5ff1a0-427d-4270-9e47-e765e8b71887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051cf95f829f4ba89a35bc9add7a68cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:27Z,use_quota=True,user_id='75cd81b24a6f4ea68660f7c705bd30ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Creating volume 5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:27 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:27 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 1073741824 Aug 26 19:02:27 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:28 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 1073741824" returned: 0 in 0.716s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:28 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 Aug 26 19:02:28 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:28 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887" returned: 0 in 0.567s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3615943b-b605-4d18-97d9-c821b6126ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5ff1a0-427d-4270-9e47-e765e8b71887', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5b026b-4823-43f4-9f7c-38115448f671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:29 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Volume volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 (5a5ff1a0-427d-4270-9e47-e765e8b71887): created successfully Aug 26 19:02:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5b026b-4823-43f4-9f7c-38115448f671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Flow 'volume_create_manager' (c64a193a-8536-49ed-a3fa-7114ab1e9582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-947e7b8d-d589-492a-96ff-30b36427e444 tempest-VolumesDeleteCascade-1040361476 None] Created volume successfully. Aug 26 19:02:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Creating offline snapshot 1739ddaa-6c43-4103-81d7-f367af5d6fed of volume 5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:02:29 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[457e2e8d-2a20-49ac-9950-bbad0471c1f9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:30 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 Aug 26 19:02:30 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (3bd1c16a-1684-495b-b16a-2bdc0ecd13d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1937c160-599a-498f-b250-6dbb10e7cde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1937c160-599a-498f-b250-6dbb10e7cde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1939883317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628e34e6-3e44-482c-b8d4-15b27df681b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:30Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc860f2-8de5-4bdc-b6f9-2aefc14aeefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc860f2-8de5-4bdc-b6f9-2aefc14aeefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5f34b2-79cf-487a-82ec-61c86b46e232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5f34b2-79cf-487a-82ec-61c86b46e232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '628e34e6-3e44-482c-b8d4-15b27df681b9', 'volume_name': 'volume-628e34e6-3e44-482c-b8d4-15b27df681b9', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2817be8-5db8-4671-a79d-7c6b51a16f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2817be8-5db8-4671-a79d-7c6b51a16f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b140783e-c99c-44b5-ba44-d0501e974ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:30 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Volume 628e34e6-3e44-482c-b8d4-15b27df681b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-628e34e6-3e44-482c-b8d4-15b27df681b9', 'volume_size': 1} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:30 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887" returned: 0 in 0.498s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:30 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed 1G Aug 26 19:02:30 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:31 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed 1G" returned: 0 in 0.664s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:31 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed Aug 26 19:02:31 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:31 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed" returned: 0 in 0.349s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:31 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed is being set with open permissions: ugo+rw Aug 26 19:02:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:31 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed Aug 26 19:02:31 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:31 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed" returned: 0 in 0.336s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:31 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.info Aug 26 19:02:31 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:32 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.info" returned: 0 in 0.360s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:32 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.info is being set with open permissions: ugo+rw Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:32 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.info Aug 26 19:02:32 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:32 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.info" returned: 0 in 0.492s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.845s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.468s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1939883317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628e34e6-3e44-482c-b8d4-15b27df681b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:30Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Creating volume 628e34e6-3e44-482c-b8d4-15b27df681b9 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:32 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7897d261-a60f-44f5-aa63-389c922d571f tempest-VolumesDeleteCascade-1040361476 None] Create snapshot completed successfully Aug 26 19:02:32 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9 1073741824 Aug 26 19:02:32 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:33 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9 1073741824" returned: 0 in 1.014s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:33 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9 Aug 26 19:02:33 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:34 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9" returned: 0 in 0.424s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b140783e-c99c-44b5-ba44-d0501e974ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628e34e6-3e44-482c-b8d4-15b27df681b9', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42970b39-fd13-479e-966c-113d85847311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:34 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Volume volume-628e34e6-3e44-482c-b8d4-15b27df681b9 (628e34e6-3e44-482c-b8d4-15b27df681b9): created successfully Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42970b39-fd13-479e-966c-113d85847311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (3bd1c16a-1684-495b-b16a-2bdc0ecd13d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-bc600986-2efe-42eb-a6b8-48a8a60fd970 tempest-VolumesActionsTest-856381984 None] Created volume successfully. Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Flow 'volume_create_manager' (e47511b9-7039-4f98-a8d2-4a0de5f43e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deb2981-4bb3-46a8-9226-2d8aea89468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deb2981-4bb3-46a8-9226-2d8aea89468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1209344097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d068bc0-88b6-4654-9356-e08f286f146d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='051cf95f829f4ba89a35bc9add7a68cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1739ddaa-6c43-4103-81d7-f367af5d6fed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:34Z,use_quota=True,user_id='75cd81b24a6f4ea68660f7c705bd30ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454cd9ab-8a08-48c6-b45b-ae0404857ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454cd9ab-8a08-48c6-b45b-ae0404857ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc73364-32ec-4c56-979c-dba1f42bfe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc73364-32ec-4c56-979c-dba1f42bfe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d068bc0-88b6-4654-9356-e08f286f146d', 'volume_name': 'volume-9d068bc0-88b6-4654-9356-e08f286f146d', 'volume_size': 1, 'snapshot_id': '1739ddaa-6c43-4103-81d7-f367af5d6fed'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef54a3e-597f-40dc-9d32-3115e0cc9547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef54a3e-597f-40dc-9d32-3115e0cc9547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f87c26c-5f57-4c97-a194-c539648a690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:34 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Volume 9d068bc0-88b6-4654-9356-e08f286f146d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d068bc0-88b6-4654-9356-e08f286f146d', 'volume_size': 1, 'snapshot_id': '1739ddaa-6c43-4103-81d7-f367af5d6fed'} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-1739ddaa-6c43-4103-81d7-f367af5d6fed-9d068bc0-88b6-4654-9356-e08f286f146d" by "_create_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-1739ddaa-6c43-4103-81d7-f367af5d6fed-9d068bc0-88b6-4654-9356-e08f286f146d" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Creating volume 9d068bc0-88b6-4654-9356-e08f286f146d from snapshot 1739ddaa-6c43-4103-81d7-f367af5d6fed {{(pid=93671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-9d068bc0-88b6-4654-9356-e08f286f146d" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-9d068bc0-88b6-4654-9356-e08f286f146d" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] snapshot: 1739ddaa-6c43-4103-81d7-f367af5d6fed, volume: 9d068bc0-88b6-4654-9356-e08f286f146d, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f71382-df1d-446b-8b0a-65afa910f23f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:34 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed Aug 26 19:02:34 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:35 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed" returned: 0 in 0.629s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a5ff1a0-427d-4270-9e47-e765e8b71887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:02:35 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88d6cf7-fb8f-4d3d-9b9e-129783de681c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:35 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 Aug 26 19:02:35 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Acquiring lock "cinder-628e34e6-3e44-482c-b8d4-15b27df681b9-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Lock "cinder-628e34e6-3e44-482c-b8d4-15b27df681b9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Acquiring lock "cinder-quobyte-628e34e6-3e44-482c-b8d4-15b27df681b9" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Lock "cinder-quobyte-628e34e6-3e44-482c-b8d4-15b27df681b9" acquired by "delete_volume" :: waited 0.053s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:36 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887" returned: 0 in 0.774s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce96d07f-0a07-4e26-a4ca-dce6c5c2a8da]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:36 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d Aug 26 19:02:36 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:36 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9 Aug 26 19:02:36 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:37 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9" returned: 0 in 1.188s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:37 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9 Aug 26 19:02:37 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:38 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-628e34e6-3e44-482c-b8d4-15b27df681b9" returned: 0 in 0.733s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Lock "cinder-quobyte-628e34e6-3e44-482c-b8d4-15b27df681b9" released by "delete_volume" :: held 2.080s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:38 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Created reservations ['24a77998-0d0c-403e-94f8-99a23d681f56', 'c4780d16-324d-41cf-8a3b-3185cff4bbd4', '9f320809-9b71-4cb5-b873-94549750261a', '7362cfdc-1d65-4740-9c64-9325c262a39e'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:39 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:39 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:40 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 1.253s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:40 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Deleted volume successfully. Aug 26 19:02:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bfcea77b-ba8a-436b-9f24-69e7a9f44634 tempest-VolumesActionsTest-76283468 None] Lock "cinder-628e34e6-3e44-482c-b8d4-15b27df681b9-delete_volume" released by "delete_volume" :: held 4.346s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:41 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Flow 'volume_create_manager' (1c197c2b-7e8f-428d-a101-5ca04af5fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d37df7d-3b00-456a-9eeb-af5f3ba08784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d37df7d-3b00-456a-9eeb-af5f3ba08784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1223396711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a8024f-4ac6-405b-adbc-e519c9a4331d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05914359e7549928d85c61107465dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:41Z,use_quota=True,user_id='f71abe5239b6485cb67d90af8dbc366d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2e3bc4-5600-4af6-ae7e-2a04b28d1d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2e3bc4-5600-4af6-ae7e-2a04b28d1d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3f3f23-1845-4561-ad25-40f88f016ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:41 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (510feccd-e8ca-4a43-9412-e30ed0e8b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e17a8dd-6d0e-4fb2-9a56-f9e65c8ef554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e17a8dd-6d0e-4fb2-9a56-f9e65c8ef554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-156301727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b15f693-90fc-447c-98df-2239dd0ba13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:42Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60cc4cf-c469-46d5-a9df-4b32250a7ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60cc4cf-c469-46d5-a9df-4b32250a7ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73e2aab-67fe-4936-b28c-06e9f78defa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73e2aab-67fe-4936-b28c-06e9f78defa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b15f693-90fc-447c-98df-2239dd0ba13b', 'volume_name': 'volume-3b15f693-90fc-447c-98df-2239dd0ba13b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bad5a8-b2c0-42e0-9fa5-a99a5cc9788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bad5a8-b2c0-42e0-9fa5-a99a5cc9788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a2c33b-755d-435e-be63-87cf652be5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:42 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Volume 3b15f693-90fc-447c-98df-2239dd0ba13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b15f693-90fc-447c-98df-2239dd0ba13b', 'volume_size': 1} Aug 26 19:02:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3f3f23-1845-4561-ad25-40f88f016ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42a8024f-4ac6-405b-adbc-e519c9a4331d', 'volume_name': 'volume-42a8024f-4ac6-405b-adbc-e519c9a4331d', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ded7325-48e2-4a1b-aab2-4126f89d40d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ded7325-48e2-4a1b-aab2-4126f89d40d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5d751d-6d06-4d39-84b2-207850fea6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:43 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Volume 42a8024f-4ac6-405b-adbc-e519c9a4331d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42a8024f-4ac6-405b-adbc-e519c9a4331d', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 19:02:43 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Trying to clone 42a8024f-4ac6-405b-adbc-e519c9a4331d from image a20b2d73-0a49-4820-9be0-26e70205cff9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD, size 20.69 MB, duration 1.14 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 19:02:44 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Image download 20.69 MB at 18.10 MB/s Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f171b7-808e-46f0-be47-e4b4311032ee]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:44 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d" returned: 0 in 8.231s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887, size 1024.00 MB, duration 8.23 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:02:44 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Converted 1024.00 MB image at 124.39 MB/s Aug 26 19:02:44 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d is being set with open permissions: ugo+rw Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:44 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d Aug 26 19:02:44 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:44 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD Aug 26 19:02:44 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:44 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d" returned: 0 in 0.268s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-9d068bc0-88b6-4654-9356-e08f286f146d" released by "_copy_volume_from_snapshot" :: held 10.068s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-1739ddaa-6c43-4103-81d7-f367af5d6fed-9d068bc0-88b6-4654-9356-e08f286f146d" released by "_create_volume_from_snapshot" :: held 10.173s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.202s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.320s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-156301727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b15f693-90fc-447c-98df-2239dd0ba13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:42Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Creating volume 3b15f693-90fc-447c-98df-2239dd0ba13b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:44 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:44 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b 1073741824 Aug 26 19:02:44 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:44 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 is fetched for user f71abe5239b6485cb67d90af8dbc366d. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f87c26c-5f57-4c97-a194-c539648a690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d068bc0-88b6-4654-9356-e08f286f146d', 'volume_size': 1, 'snapshot_id': '1739ddaa-6c43-4103-81d7-f367af5d6fed'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11a38c6-23f3-40bc-823d-20b1ae402c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:44 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Volume volume-9d068bc0-88b6-4654-9356-e08f286f146d (9d068bc0-88b6-4654-9356-e08f286f146d): created successfully Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11a38c6-23f3-40bc-823d-20b1ae402c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Flow 'volume_create_manager' (e47511b9-7039-4f98-a8d2-4a0de5f43e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:44 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9e3ac9f6-feca-45ff-96e2-859ea06a04b0 tempest-VolumesDeleteCascade-1040361476 None] Created volume successfully. Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c17d0a-426e-40ed-b114-45d3101b503b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:45 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD Aug 26 19:02:45 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-5a5ff1a0-427d-4270-9e47-e765e8b71887-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-5a5ff1a0-427d-4270-9e47-e765e8b71887-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Performing cascade delete. {{(pid=93671) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-1739ddaa-6c43-4103-81d7-f367af5d6fed-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-1739ddaa-6c43-4103-81d7-f367af5d6fed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:45 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:45 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b 1073741824" returned: 0 in 0.570s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-5a5ff1a0-427d-4270-9e47-e765e8b71887" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-5a5ff1a0-427d-4270-9e47-e765e8b71887" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-1739ddaa-6c43-4103-81d7-f367af5d6fed" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-1739ddaa-6c43-4103-81d7-f367af5d6fed" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Deleting offline snapshot 1739ddaa-6c43-4103-81d7-f367af5d6fed of volume 5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] snapshot_file for this snap is: volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2803cd84-229a-4800-987b-3d5ba39ad970]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:45 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b Aug 26 19:02:45 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:45 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed Aug 26 19:02:45 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:45 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b" returned: 0 in 0.274s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.348s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1223396711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a8024f-4ac6-405b-adbc-e519c9a4331d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e05914359e7549928d85c61107465dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:41Z,use_quota=True,user_id='f71abe5239b6485cb67d90af8dbc366d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Creating volume 42a8024f-4ac6-405b-adbc-e519c9a4331d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:45 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:45 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d 1073741824 Aug 26 19:02:45 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a2c33b-755d-435e-be63-87cf652be5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b15f693-90fc-447c-98df-2239dd0ba13b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bed36b0-a59d-4219-89bd-bd630703321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:45 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Volume volume-3b15f693-90fc-447c-98df-2239dd0ba13b (3b15f693-90fc-447c-98df-2239dd0ba13b): created successfully Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bed36b0-a59d-4219-89bd-bd630703321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (510feccd-e8ca-4a43-9412-e30ed0e8b186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e4816f72-e0f4-4dbc-8bcb-56278d7c0db7 tempest-VolumesActionsTest-856381984 None] Created volume successfully. Aug 26 19:02:45 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed" returned: 0 in 0.394s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a5ff1a0-427d-4270-9e47-e765e8b71887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450859e-795f-4336-ba02-d648b20ce7ec]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:46 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 Aug 26 19:02:46 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:46 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Flow 'volume_create_manager' (daa6ef6f-2e67-4c95-9050-74e65d33c62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3711270-4642-49fa-aaa4-319c21aee439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d 1073741824" returned: 0 in 0.567s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3711270-4642-49fa-aaa4-319c21aee439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1129522635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035eb2dc-74e7-4ff2-a30c-ebfd770949ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8be5cd1f8e461ca9092c9dd26ef20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:46Z,use_quota=True,user_id='68116c8c7acf422f8f6e2488b70f7ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1da1655-95c4-4440-a967-312e23c25675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1da1655-95c4-4440-a967-312e23c25675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb42a4d-bf7b-4ca2-b198-1a6e12b0254f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb42a4d-bf7b-4ca2-b198-1a6e12b0254f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035eb2dc-74e7-4ff2-a30c-ebfd770949ec', 'volume_name': 'volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b9522d-431a-4664-91a7-76c07781f42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b9522d-431a-4664-91a7-76c07781f42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434ae5ff-fe22-49a0-8568-fde853e99712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:46 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Volume 035eb2dc-74e7-4ff2-a30c-ebfd770949ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec', 'volume_size': 1} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:46 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d Aug 26 19:02:46 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:46 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887" returned: 0 in 0.622s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:46 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed Aug 26 19:02:46 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Acquiring lock "cinder-3b15f693-90fc-447c-98df-2239dd0ba13b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Lock "cinder-3b15f693-90fc-447c-98df-2239dd0ba13b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:46 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d" returned: 0 in 0.362s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Acquiring lock "cinder-quobyte-3b15f693-90fc-447c-98df-2239dd0ba13b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1129522635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035eb2dc-74e7-4ff2-a30c-ebfd770949ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8be5cd1f8e461ca9092c9dd26ef20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:46Z,use_quota=True,user_id='68116c8c7acf422f8f6e2488b70f7ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Creating volume 035eb2dc-74e7-4ff2-a30c-ebfd770949ec {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:46 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:46 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec 1073741824 Aug 26 19:02:46 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Attempting download of a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume 42a8024f-4ac6-405b-adbc-e519c9a4331d. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Lock "cinder-quobyte-3b15f693-90fc-447c-98df-2239dd0ba13b" acquired by "delete_volume" :: waited 0.054s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45e60fd-aba4-48c1-ac91-b8f390667dce]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e156d44d-5649-4f5a-862c-45e00658a7e6]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_8lp_or6u {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:46 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed" returned: 0 in 0.460s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:47 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b Aug 26 19:02:47 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:47 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed Aug 26 19:02:47 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:47 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_8lp_or6u Aug 26 19:02:47 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:47 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887.1739ddaa-6c43-4103-81d7-f367af5d6fed" returned: 0 in 0.296s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:47 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec 1073741824" returned: 0 in 0.515s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-1739ddaa-6c43-4103-81d7-f367af5d6fed" released by "_delete_snapshot" :: held 1.882s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:47 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_8lp_or6u" returned: 0 in 0.429s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_8lp_or6u {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:47 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-5a5ff1a0-427d-4270-9e47-e765e8b71887" released by "delete_snapshot" :: held 1.930s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b" returned: 0 in 0.495s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:47 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b Aug 26 19:02:47 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:47 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec Aug 26 19:02:47 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:47 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_8lp_or6u Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Created reservations ['3f163702-8f12-4ae8-98cb-209c271c248e', 'eb46d8d0-2032-4571-a393-517f5fa2bf4e', '5e5a9f44-d6a0-4ca7-b03b-d75e6c3806eb', 'fd5a46b8-515a-4cee-92aa-d72987276f1a'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:47 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:47 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Delete snapshot completed successfully. Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-1739ddaa-6c43-4103-81d7-f367af5d6fed-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Snapshots deleted, issuing volume delete {{(pid=93671) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-5a5ff1a0-427d-4270-9e47-e765e8b71887" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-5a5ff1a0-427d-4270-9e47-e765e8b71887" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[493c0528-6394-473d-8c09-7407d704c83b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:47 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3b15f693-90fc-447c-98df-2239dd0ba13b" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Lock "cinder-quobyte-3b15f693-90fc-447c-98df-2239dd0ba13b" released by "delete_volume" :: held 0.884s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:47 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 Aug 26 19:02:47 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:47 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec" returned: 0 in 0.335s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:47 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_8lp_or6u" returned: 1 in 0.429s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_8lp_or6u' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d35a14-fa2b-4f09-a0b5-948a95a23940]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434ae5ff-fe22-49a0-8568-fde853e99712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c4a60e-ad76-4187-bcf8-b838374f6b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:47 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Volume volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec (035eb2dc-74e7-4ff2-a30c-ebfd770949ec): created successfully Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c4a60e-ad76-4187-bcf8-b838374f6b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Flow 'volume_create_manager' (daa6ef6f-2e67-4c95-9050-74e65d33c62a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Created reservations ['f4bf7589-0bf1-4efc-b578-4698e14acb1f', '3ecf08af-0202-40f2-8005-1352b27ab531', 'c20678ae-94db-461c-99c6-984387f6510b', '6589fb5e-4e3d-4777-8542-894d72ffdf53'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:47 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4b3659e8-7168-4deb-b012-1ca0b3580562 tempest-ServersNegativeTestJSON-1738523972 None] Created volume successfully. Aug 26 19:02:47 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD Aug 26 19:02:47 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:47 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:47 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:48 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887" returned: 0 in 0.426s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:48 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887 Aug 26 19:02:48 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:48 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] a20b2d73-0a49-4820-9be0-26e70205cff9 was qcow2, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:48 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d Aug 26 19:02:48 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:48 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Deleted volume successfully. Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b13f6742-8ca5-44b5-ae14-21496188c39a tempest-VolumesActionsTest-76283468 None] Lock "cinder-3b15f693-90fc-447c-98df-2239dd0ba13b-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:48 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5a5ff1a0-427d-4270-9e47-e765e8b71887" returned: 0 in 0.302s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-5a5ff1a0-427d-4270-9e47-e765e8b71887" released by "delete_volume" :: held 0.801s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Created reservations ['b53cf117-74d0-4988-bf6e-90c26e283515', '9a4e4e81-7b9c-4696-bf1c-28c83c3064bf', 'f498fc82-9798-41a8-b464-e9e6dc4632a6', 'ee9f099b-d808-45ea-a32d-76d05c4786e7'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:48 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:48 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:48 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.312s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-9d068bc0-88b6-4654-9356-e08f286f146d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Deleted volume successfully. Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-9d068bc0-88b6-4654-9356-e08f286f146d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cdd8f58-ea84-478b-81d2-588c8d0358ec tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-5a5ff1a0-427d-4270-9e47-e765e8b71887-delete_volume" released by "delete_volume" :: held 3.616s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "cinder-quobyte-9d068bc0-88b6-4654-9356-e08f286f146d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-9d068bc0-88b6-4654-9356-e08f286f146d" acquired by "delete_volume" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ae495-574a-4376-b5aa-2eff5c5efa90]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:49 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d Aug 26 19:02:49 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:49 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d" returned: 0 in 0.419s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:49 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d Aug 26 19:02:49 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (5a7a05b0-d955-4a5d-9631-f832603be179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1554cc85-97cc-4712-bee0-d443c58aeae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1554cc85-97cc-4712-bee0-d443c58aeae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-114380904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3e5a86-fccc-4a48-a062-44a9ede03200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:50Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:49 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c89efe-56fb-44e8-b1e1-f8e9cfce164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c89efe-56fb-44e8-b1e1-f8e9cfce164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25cde1f-c95d-49cb-991c-c74d5fcb86d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25cde1f-c95d-49cb-991c-c74d5fcb86d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3e5a86-fccc-4a48-a062-44a9ede03200', 'volume_name': 'volume-4c3e5a86-fccc-4a48-a062-44a9ede03200', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e164666a-cc64-4637-9fe0-8e522ac0fade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e164666a-cc64-4637-9fe0-8e522ac0fade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8638a5-5e2c-4a81-9a73-a2cbe3b26dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:49 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Volume 4c3e5a86-fccc-4a48-a062-44a9ede03200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3e5a86-fccc-4a48-a062-44a9ede03200', 'volume_size': 1} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-114380904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3e5a86-fccc-4a48-a062-44a9ede03200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:50Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Creating volume 4c3e5a86-fccc-4a48-a062-44a9ede03200 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:49 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d068bc0-88b6-4654-9356-e08f286f146d" returned: 0 in 0.421s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-quobyte-9d068bc0-88b6-4654-9356-e08f286f146d" released by "delete_volume" :: held 0.925s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:49 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 1073741824 Aug 26 19:02:49 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Created reservations ['acecea02-45ef-45bd-b731-117f163c47bc', '0316a517-86e6-46b9-acb0-c5dbd6076a3f', '95e7fd39-54c6-4882-8ba1-3c993d784ae2', '402b807b-b8dd-4cf6-887f-902fb1dbbdca'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:50 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:50 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:50 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Flow 'volume_create_manager' (7ebe0392-e9c8-48ac-84de-7d6a62df2475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1ca2f3-d1af-4510-9369-a760e77e6fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.313s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:50 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Deleted volume successfully. Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1ca2f3-d1af-4510-9369-a760e77e6fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-999286151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6952c249-7743-459a-9078-a6efead6a7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8be5cd1f8e461ca9092c9dd26ef20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:50Z,use_quota=True,user_id='68116c8c7acf422f8f6e2488b70f7ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63166155-e33a-41ae-9fc2-4aed0bd78e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63166155-e33a-41ae-9fc2-4aed0bd78e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fc8127-5ef3-420f-a2a9-2f900e8040b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fc8127-5ef3-420f-a2a9-2f900e8040b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6952c249-7743-459a-9078-a6efead6a7f0', 'volume_name': 'volume-6952c249-7743-459a-9078-a6efead6a7f0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf09852-ae03-4afb-a2cc-20e099cdb5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf09852-ae03-4afb-a2cc-20e099cdb5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1871cdb4-828d-422c-b26e-8bdbf948c3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:50 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Volume 6952c249-7743-459a-9078-a6efead6a7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6952c249-7743-459a-9078-a6efead6a7f0', 'volume_size': 1} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:50 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 1073741824" returned: 0 in 0.701s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a5c71d4-214a-4d50-a59c-c398d9671205 tempest-VolumesDeleteCascade-1040361476 None] Lock "cinder-9d068bc0-88b6-4654-9356-e08f286f146d-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:50 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 Aug 26 19:02:50 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:50 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d" returned: 0 in 2.563s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_jp0ym8nmdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:02:50 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Converted 112.00 MB image at 43.68 MB/s Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:50 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d 1G Aug 26 19:02:50 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:50 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200" returned: 0 in 0.276s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-999286151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6952c249-7743-459a-9078-a6efead6a7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8be5cd1f8e461ca9092c9dd26ef20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:50Z,use_quota=True,user_id='68116c8c7acf422f8f6e2488b70f7ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Creating volume 6952c249-7743-459a-9078-a6efead6a7f0 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:50 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8638a5-5e2c-4a81-9a73-a2cbe3b26dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3e5a86-fccc-4a48-a062-44a9ede03200', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bb3fbe-dd97-443a-a043-df77ac6024f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:50 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0 1073741824 Aug 26 19:02:50 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:50 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Volume volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 (4c3e5a86-fccc-4a48-a062-44a9ede03200): created successfully Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bb3fbe-dd97-443a-a043-df77ac6024f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (5a7a05b0-d955-4a5d-9631-f832603be179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:51 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4dc09b3d-bd65-4bd5-a2dd-98f4f27964b0 tempest-VolumesActionsTest-856381984 None] Created volume successfully. Aug 26 19:02:51 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d 1G" returned: 0 in 0.349s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Downloaded image a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume 42a8024f-4ac6-405b-adbc-e519c9a4331d successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 for user f71abe5239b6485cb67d90af8dbc366d is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Marking volume 42a8024f-4ac6-405b-adbc-e519c9a4331d as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Copying metadata from image a20b2d73-0a49-4820-9be0-26e70205cff9 to 42a8024f-4ac6-405b-adbc-e519c9a4331d. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Creating volume glance metadata for volume 42a8024f-4ac6-405b-adbc-e519c9a4331d backed by image a20b2d73-0a49-4820-9be0-26e70205cff9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5d751d-6d06-4d39-84b2-207850fea6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a8024f-4ac6-405b-adbc-e519c9a4331d', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee940857-ea8c-4cfe-863e-c64c5106c517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:51 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Volume volume-42a8024f-4ac6-405b-adbc-e519c9a4331d (42a8024f-4ac6-405b-adbc-e519c9a4331d): created successfully Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee940857-ea8c-4cfe-863e-c64c5106c517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Flow 'volume_create_manager' (1c197c2b-7e8f-428d-a101-5ca04af5fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:51 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7260c0e0-2b27-4fb4-a3d1-f0acf8f26813 tempest-TestShelveInstance-2107740106 None] Created volume successfully. Aug 26 19:02:51 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0 1073741824" returned: 0 in 0.516s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:51 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0 Aug 26 19:02:51 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:51 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0" returned: 0 in 0.266s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1871cdb4-828d-422c-b26e-8bdbf948c3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6952c249-7743-459a-9078-a6efead6a7f0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747a20d8-4389-4e4e-ad46-f76d0365ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:51 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Volume volume-6952c249-7743-459a-9078-a6efead6a7f0 (6952c249-7743-459a-9078-a6efead6a7f0): created successfully Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747a20d8-4389-4e4e-ad46-f76d0365ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Flow 'volume_create_manager' (7ebe0392-e9c8-48ac-84de-7d6a62df2475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:51 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-aef952a7-682f-493c-85ce-cd8d4a143347 tempest-ServersNegativeTestJSON-1738523972 None] Created volume successfully. Aug 26 19:02:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Acquiring lock "cinder-4c3e5a86-fccc-4a48-a062-44a9ede03200-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Lock "cinder-4c3e5a86-fccc-4a48-a062-44a9ede03200-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Acquiring lock "cinder-quobyte-4c3e5a86-fccc-4a48-a062-44a9ede03200" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Lock "cinder-quobyte-4c3e5a86-fccc-4a48-a062-44a9ede03200" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:52 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dad913-f918-4824-8425-00effb9a37b2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:52 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 Aug 26 19:02:52 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:52 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200" returned: 0 in 0.448s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:52 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200 Aug 26 19:02:52 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:52 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4c3e5a86-fccc-4a48-a062-44a9ede03200" returned: 0 in 0.404s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Lock "cinder-quobyte-4c3e5a86-fccc-4a48-a062-44a9ede03200" released by "delete_volume" :: held 0.924s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Created reservations ['8522a436-ddec-4532-bae2-f4bcb8ab45eb', '61b32d5a-55af-48aa-9c77-799e954ff41f', '25787ece-d5dd-460d-8cd4-0a8b40e79245', '9dc8b58c-f1d5-4e68-8057-2000aa6b9ac5'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:53 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:53 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "cinder-6952c249-7743-459a-9078-a6efead6a7f0-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Lock "cinder-6952c249-7743-459a-9078-a6efead6a7f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "cinder-quobyte-6952c249-7743-459a-9078-a6efead6a7f0" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Lock "cinder-quobyte-6952c249-7743-459a-9078-a6efead6a7f0" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c2fc06-8205-4f25-b8dc-d8285bf328d5]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:53 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.321s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:53 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Deleted volume successfully. Aug 26 19:02:53 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0 Aug 26 19:02:53 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-30fa1d0a-db14-469d-8de4-f48c04d543d2 tempest-VolumesActionsTest-76283468 None] Lock "cinder-4c3e5a86-fccc-4a48-a062-44a9ede03200-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:53 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0" returned: 0 in 0.495s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:53 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0 Aug 26 19:02:53 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:54 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6952c249-7743-459a-9078-a6efead6a7f0" returned: 0 in 0.357s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Lock "cinder-quobyte-6952c249-7743-459a-9078-a6efead6a7f0" released by "delete_volume" :: held 0.905s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Created reservations ['0333f54d-d7af-46f5-9591-9309483f147f', 'f95a9b90-9709-4147-ac9b-e862993147a7', 'c6fc73b4-4c8e-4f99-a8d3-870426039d01', 'a3bc85fc-8ee7-4a2f-8267-c1b562ededd5'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:54 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:54 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:54 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:54 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:54 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.470s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Deleted volume successfully. Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ffbe0c67-60fc-4045-8538-220f69390e2b tempest-ServersNegativeTestJSON-1738523972 None] Lock "cinder-6952c249-7743-459a-9078-a6efead6a7f0-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:55 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "cinder-035eb2dc-74e7-4ff2-a30c-ebfd770949ec-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.650s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Lock "cinder-035eb2dc-74e7-4ff2-a30c-ebfd770949ec-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "cinder-quobyte-035eb2dc-74e7-4ff2-a30c-ebfd770949ec" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Lock "cinder-quobyte-035eb2dc-74e7-4ff2-a30c-ebfd770949ec" acquired by "delete_volume" :: waited 0.036s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d32328c-a96c-4f2f-9f42-f90a4c660ffb]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (e34812cb-06d6-413b-a5a9-bd0b52b024fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc693013-80c3-4f7c-bb66-0b11f08ad287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc693013-80c3-4f7c-bb66-0b11f08ad287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-932365271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990ece71-f177-4e4b-ad6a-c62432e4bebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:55Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2928c0dd-3459-4854-b97e-0fff4197ff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2928c0dd-3459-4854-b97e-0fff4197ff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d78ef65-ff67-4180-a2c3-268f3a38959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d78ef65-ff67-4180-a2c3-268f3a38959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990ece71-f177-4e4b-ad6a-c62432e4bebf', 'volume_name': 'volume-990ece71-f177-4e4b-ad6a-c62432e4bebf', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87446243-cca9-4c89-98c1-03fd8a8900a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87446243-cca9-4c89-98c1-03fd8a8900a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e46ccaa-fe55-49aa-9c28-998012b6cc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Volume 990ece71-f177-4e4b-ad6a-c62432e4bebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990ece71-f177-4e4b-ad6a-c62432e4bebf', 'volume_size': 1} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-932365271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990ece71-f177-4e4b-ad6a-c62432e4bebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:55Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Creating volume 990ece71-f177-4e4b-ad6a-c62432e4bebf {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:55 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:55 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf 1073741824 Aug 26 19:02:55 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec Aug 26 19:02:55 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:55 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Flow 'volume_create_manager' (3a72371c-7828-4a0f-a8d8-6766fb1a6004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c85108-c4b3-42ee-bbae-9fb6e83ff945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c85108-c4b3-42ee-bbae-9fb6e83ff945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1346207106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f675a4f-704b-433d-8baa-389a2e4b1dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49204a31c01e4b43bae72ba1110d14a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:56Z,use_quota=True,user_id='8f570afb98f54952ba057089140a7d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcfdfae-bc89-49cd-ae0c-9b48521a6c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcfdfae-bc89-49cd-ae0c-9b48521a6c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ab6031-bbfd-4a03-ba84-1f798626d58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ab6031-bbfd-4a03-ba84-1f798626d58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f675a4f-704b-433d-8baa-389a2e4b1dfe', 'volume_name': 'volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ac64a3-629f-4250-87d6-343874b0e056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ac64a3-629f-4250-87d6-343874b0e056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3c5183-8b5f-4cf6-9512-344ae903c170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:55 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Volume 1f675a4f-704b-433d-8baa-389a2e4b1dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe', 'volume_size': 1} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec" returned: 0 in 0.561s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:55 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec Aug 26 19:02:55 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:56 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf 1073741824" returned: 0 in 0.674s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:56 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:56 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf Aug 26 19:02:56 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-035eb2dc-74e7-4ff2-a30c-ebfd770949ec" returned: 0 in 0.354s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Lock "cinder-quobyte-035eb2dc-74e7-4ff2-a30c-ebfd770949ec" released by "delete_volume" :: held 0.992s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-fe21fc67-4bca-43cf-b13d-4a8e99dd8da2 req-05352d1e-4c1a-4e02-97ac-2a4bbb818503 tempest-TestShelveInstance-2107740106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Created reservations ['e9131f95-ddc2-4aa1-a7d2-8b7ad14ec2df', '6f154687-3253-4827-9347-3bbba5e40795', 'f0d9b76c-a4af-4084-902e-238ed8318633', '8201e3a5-9d9d-4d7e-a29f-795a0b3cd839'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:56 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:56 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:56 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf" returned: 0 in 0.354s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1346207106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f675a4f-704b-433d-8baa-389a2e4b1dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49204a31c01e4b43bae72ba1110d14a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:02:56Z,use_quota=True,user_id='8f570afb98f54952ba057089140a7d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Creating volume 1f675a4f-704b-433d-8baa-389a2e4b1dfe {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:02:56 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e46ccaa-fe55-49aa-9c28-998012b6cc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990ece71-f177-4e4b-ad6a-c62432e4bebf', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e812c35a-c1af-44eb-9a0f-dafd76990fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:56 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe 1073741824 Aug 26 19:02:56 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:56 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Volume volume-990ece71-f177-4e4b-ad6a-c62432e4bebf (990ece71-f177-4e4b-ad6a-c62432e4bebf): created successfully Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e812c35a-c1af-44eb-9a0f-dafd76990fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (e34812cb-06d6-413b-a5a9-bd0b52b024fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:56 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2afd9d13-20f1-4e4d-b786-c1c52dd9e9bb tempest-VolumesActionsTest-856381984 None] Created volume successfully. Aug 26 19:02:56 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.312s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:02:56 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Deleted volume successfully. Aug 26 19:02:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2ac66e98-9534-483c-9a40-62af7cfc5a97 tempest-ServersNegativeTestJSON-1738523972 None] Lock "cinder-035eb2dc-74e7-4ff2-a30c-ebfd770949ec-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:57 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe 1073741824" returned: 0 in 0.546s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:57 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe Aug 26 19:02:57 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:57 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe" returned: 0 in 0.319s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-fe21fc67-4bca-43cf-b13d-4a8e99dd8da2 req-05352d1e-4c1a-4e02-97ac-2a4bbb818503 tempest-TestShelveInstance-2107740106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.161s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=136,cinder:SELECT=114,cinder:DELETE=11,cinder:INSERT=35 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3c5183-8b5f-4cf6-9512-344ae903c170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a590d14-c44a-49bf-a6ed-2d57524553bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-fe21fc67-4bca-43cf-b13d-4a8e99dd8da2 req-05352d1e-4c1a-4e02-97ac-2a4bbb818503 tempest-TestShelveInstance-2107740106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.075s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:57 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Volume volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe (1f675a4f-704b-433d-8baa-389a2e4b1dfe): created successfully Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a590d14-c44a-49bf-a6ed-2d57524553bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Flow 'volume_create_manager' (3a72371c-7828-4a0f-a8d8-6766fb1a6004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=115,cinder:INSERT=42,cinder:UPDATE=132,cinder:DELETE=12 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:02:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7d441562-7059-403c-ac5c-f72ac1d0a187 tempest-VolumesMetadataTest-1390432466 None] Created volume successfully. Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-fe21fc67-4bca-43cf-b13d-4a8e99dd8da2 req-05352d1e-4c1a-4e02-97ac-2a4bbb818503 tempest-TestShelveInstance-2107740106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-42a8024f-4ac6-405b-adbc-e519c9a4331d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2658d6d-e039-4542-8260-dbc36778c66f', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:02:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-fe21fc67-4bca-43cf-b13d-4a8e99dd8da2 req-05352d1e-4c1a-4e02-97ac-2a4bbb818503 tempest-TestShelveInstance-2107740106 None] attachment_update completed successfully. Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Acquiring lock "cinder-990ece71-f177-4e4b-ad6a-c62432e4bebf-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Lock "cinder-990ece71-f177-4e4b-ad6a-c62432e4bebf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Acquiring lock "cinder-quobyte-990ece71-f177-4e4b-ad6a-c62432e4bebf" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Lock "cinder-quobyte-990ece71-f177-4e4b-ad6a-c62432e4bebf" acquired by "delete_volume" :: waited 0.047s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:58 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d85bc8-f8cf-4def-a41e-363323782781]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:58 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf Aug 26 19:02:58 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:58 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf" returned: 0 in 0.846s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:59 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf Aug 26 19:02:59 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:59 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-990ece71-f177-4e4b-ad6a-c62432e4bebf" returned: 0 in 0.491s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Lock "cinder-quobyte-990ece71-f177-4e4b-ad6a-c62432e4bebf" released by "delete_volume" :: held 1.458s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Created reservations ['9a630074-4f32-4c07-96bf-f9f7b41edb18', '301e28ab-3011-420f-ac0a-257a9bccbb5a', '8b9e91ce-fc44-47be-aa34-e166644df604', '6ceaa3b3-7532-464a-9aa3-a97dff9a69ba'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Acquiring lock "cinder-1f675a4f-704b-433d-8baa-389a2e4b1dfe-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Lock "cinder-1f675a4f-704b-433d-8baa-389a2e4b1dfe-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:59 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:02:59 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Acquiring lock "cinder-quobyte-1f675a4f-704b-433d-8baa-389a2e4b1dfe" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Lock "cinder-quobyte-1f675a4f-704b-433d-8baa-389a2e4b1dfe" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b220ab3-c1b7-4f3e-97cc-c26320bde127]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:02:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:00 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:00 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe Aug 26 19:03:00 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.355s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:00 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:00 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Deleted volume successfully. Aug 26 19:03:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1390455-9913-4a98-9568-e0229b0ddb8b tempest-VolumesActionsTest-76283468 None] Lock "cinder-990ece71-f177-4e4b-ad6a-c62432e4bebf-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:00 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe" returned: 0 in 0.598s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:00 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe Aug 26 19:03:00 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:01 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1f675a4f-704b-433d-8baa-389a2e4b1dfe" returned: 0 in 0.591s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Lock "cinder-quobyte-1f675a4f-704b-433d-8baa-389a2e4b1dfe" released by "delete_volume" :: held 1.280s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (935e2d66-680b-4308-b36e-6cab5f3741e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4228d6-a565-463d-a35d-39f99a0fe3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Created reservations ['61bc9967-1f03-42a1-bfba-9c0a035e9014', '21d57bd8-7c9a-4029-be5c-84b22173dc14', 'bffc656e-0664-46f1-8411-48f7f0f3ffaa', '8c48ddfc-7d96-4998-bbf9-436760fc84c8'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4228d6-a565-463d-a35d-39f99a0fe3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48580811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad35245-46d3-4a21-852b-3d8d6ea2a61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:01Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9154c8d-0f19-46fc-992a-edbce989ecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9154c8d-0f19-46fc-992a-edbce989ecac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832955dc-d2a7-4373-848e-d859c2f866b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832955dc-d2a7-4373-848e-d859c2f866b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad35245-46d3-4a21-852b-3d8d6ea2a61e', 'volume_name': 'volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7968f422-9a71-46c1-bf26-2609dad8c795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7968f422-9a71-46c1-bf26-2609dad8c795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab3a8cd-b691-4134-a88a-9bd9f54fefd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:01 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Volume fad35245-46d3-4a21-852b-3d8d6ea2a61e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e', 'volume_size': 1} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48580811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad35245-46d3-4a21-852b-3d8d6ea2a61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d0f71816ae46c4b3442399ed883fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:01Z,use_quota=True,user_id='8205ef41d17d4f43aad01995b4f9ea6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Creating volume fad35245-46d3-4a21-852b-3d8d6ea2a61e {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:01 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:01 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e 1073741824 Aug 26 19:03:01 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:01 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:01 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:02 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.525s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:02 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Deleted volume successfully. Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f7ffb7e4-15b7-49ef-9914-819bb095b315 tempest-VolumesMetadataTest-1390432466 None] Lock "cinder-1f675a4f-704b-433d-8baa-389a2e4b1dfe-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:02 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e 1073741824" returned: 0 in 0.807s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:02 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e Aug 26 19:03:02 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:02 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e" returned: 0 in 0.454s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab3a8cd-b691-4134-a88a-9bd9f54fefd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc6b9ff-7d54-49c7-8aa8-0af49a406eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:02 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Volume volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e (fad35245-46d3-4a21-852b-3d8d6ea2a61e): created successfully Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc6b9ff-7d54-49c7-8aa8-0af49a406eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Flow 'volume_create_manager' (935e2d66-680b-4308-b36e-6cab5f3741e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:02 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7393a55c-bfd1-4d47-8763-75170e7eab3f tempest-VolumesActionsTest-856381984 None] Created volume successfully. Aug 26 19:03:04 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Acquiring lock "cinder-fad35245-46d3-4a21-852b-3d8d6ea2a61e-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:04 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Lock "cinder-fad35245-46d3-4a21-852b-3d8d6ea2a61e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:04 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Acquiring lock "cinder-quobyte-fad35245-46d3-4a21-852b-3d8d6ea2a61e" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:04 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Lock "cinder-quobyte-fad35245-46d3-4a21-852b-3d8d6ea2a61e" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:04 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c84a10-22bf-4688-89cf-7135141a8715]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:04 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e Aug 26 19:03:04 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:05 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e" returned: 0 in 0.548s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:05 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e Aug 26 19:03:05 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:05 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fad35245-46d3-4a21-852b-3d8d6ea2a61e" returned: 0 in 0.461s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Lock "cinder-quobyte-fad35245-46d3-4a21-852b-3d8d6ea2a61e" released by "delete_volume" :: held 1.093s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:05 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Created reservations ['9510ba73-bc04-42f3-b460-1659f4cc79e8', '335aaf43-5dd2-4908-ad34-a079b6e39242', 'cfea0b83-f488-45d6-b5c0-209b8ac5fbbb', '2c8844d9-a351-4b62-a706-c8a40fd60897'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:06 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:06 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:06 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.335s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:06 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:06 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Deleted volume successfully. Aug 26 19:03:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7beff2f9-f5ac-4cd1-8e6f-8b84c28debd6 tempest-VolumesActionsTest-856381984 None] Lock "cinder-fad35245-46d3-4a21-852b-3d8d6ea2a61e-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Flow 'volume_create_manager' (8fbcd070-b794-452a-92c5-84f551cf9633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832c647c-7c07-43de-bcd1-e53e9beba9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832c647c-7c07-43de-bcd1-e53e9beba9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2113628643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2068585e-ff20-4dba-bf39-794037e2edb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9411bd6e11454387a8ad35f624afd623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:10Z,use_quota=True,user_id='f207aff0ceb34b57b11f75860873fbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4ada79-3d15-4ac8-b308-0b4bbc193ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4ada79-3d15-4ac8-b308-0b4bbc193ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d778a9-3f5c-485a-9a27-13bcff449ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d778a9-3f5c-485a-9a27-13bcff449ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2068585e-ff20-4dba-bf39-794037e2edb4', 'volume_name': 'volume-2068585e-ff20-4dba-bf39-794037e2edb4', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fbd2b9-1bda-4460-8be5-c1a179c6958d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fbd2b9-1bda-4460-8be5-c1a179c6958d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216a63d9-8477-459d-ae8c-5c164ab38797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:10 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Volume 2068585e-ff20-4dba-bf39-794037e2edb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2068585e-ff20-4dba-bf39-794037e2edb4', 'volume_size': 1} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2113628643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2068585e-ff20-4dba-bf39-794037e2edb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9411bd6e11454387a8ad35f624afd623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:10Z,use_quota=True,user_id='f207aff0ceb34b57b11f75860873fbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Creating volume 2068585e-ff20-4dba-bf39-794037e2edb4 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:10 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:10 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4 1073741824 Aug 26 19:03:10 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:11 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4 1073741824" returned: 0 in 0.772s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:11 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4 Aug 26 19:03:11 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:11 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4" returned: 0 in 0.427s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216a63d9-8477-459d-ae8c-5c164ab38797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2068585e-ff20-4dba-bf39-794037e2edb4', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb65c6e-2be9-4bc6-a7b2-607592f15bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:11 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Volume volume-2068585e-ff20-4dba-bf39-794037e2edb4 (2068585e-ff20-4dba-bf39-794037e2edb4): created successfully Aug 26 19:03:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb65c6e-2be9-4bc6-a7b2-607592f15bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Flow 'volume_create_manager' (8fbcd070-b794-452a-92c5-84f551cf9633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7bc1586e-a68b-47a9-a975-75e40fe60d62 tempest-VolumesTransfersTest-599231264 None] Created volume successfully. Aug 26 19:03:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-55a24484-a0fe-4cbf-a8a0-1deec89ef399 tempest-VolumesTransfersTest-2033490891 None] Transfer volume completed successfully. Aug 26 19:03:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Acquiring lock "cinder-2068585e-ff20-4dba-bf39-794037e2edb4-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Lock "cinder-2068585e-ff20-4dba-bf39-794037e2edb4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Acquiring lock "cinder-quobyte-2068585e-ff20-4dba-bf39-794037e2edb4" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Lock "cinder-quobyte-2068585e-ff20-4dba-bf39-794037e2edb4" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:14 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed055352-edeb-46c7-b7d6-6385173598d2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:15 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4 Aug 26 19:03:15 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:15 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4" returned: 0 in 0.551s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:15 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4 Aug 26 19:03:15 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:15 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2068585e-ff20-4dba-bf39-794037e2edb4" returned: 0 in 0.392s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Lock "cinder-quobyte-2068585e-ff20-4dba-bf39-794037e2edb4" released by "delete_volume" :: held 1.009s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Created reservations ['66022e16-49db-4779-adcf-88c4a3c24292', 'db8fb108-46c0-4e4b-9bba-15a35413eeb9', 'e32a958a-6d9f-42c0-b222-c453dbb6538c', 'e1a06525-855a-4f63-97f5-896b8c83e368'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:16 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:16 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:16 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.344s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:16 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Deleted volume successfully. Aug 26 19:03:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e16e8b1d-a3b1-49c3-87b0-488d0643d650 tempest-VolumesTransfersTest-918495541 None] Lock "cinder-2068585e-ff20-4dba-bf39-794037e2edb4-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Flow 'volume_create_manager' (c1540f2d-96fd-475f-9a93-dc8076c1e6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f86199-8dc2-4ef0-afe3-f96755628449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f86199-8dc2-4ef0-afe3-f96755628449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-79907949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042e5678-3904-47f5-abfc-dfd9ae011bea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ecac35bc70f044ceaa0be2c30b1dc8b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:17Z,use_quota=True,user_id='dda96f8dfd1248ec9022f50fc108944e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0160dc-47e8-41c1-81b8-4c7b03cb1418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0160dc-47e8-41c1-81b8-4c7b03cb1418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409a2de5-e3b9-4797-8e39-e2617bc772aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409a2de5-e3b9-4797-8e39-e2617bc772aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042e5678-3904-47f5-abfc-dfd9ae011bea', 'volume_name': 'volume-042e5678-3904-47f5-abfc-dfd9ae011bea', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108eb8f9-21dd-48cc-9a8f-96c019ae2559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (108eb8f9-21dd-48cc-9a8f-96c019ae2559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f243192-4af7-4020-9017-a00255ecc623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:17 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Volume 042e5678-3904-47f5-abfc-dfd9ae011bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042e5678-3904-47f5-abfc-dfd9ae011bea', 'volume_size': 1} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-79907949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042e5678-3904-47f5-abfc-dfd9ae011bea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ecac35bc70f044ceaa0be2c30b1dc8b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:17Z,use_quota=True,user_id='dda96f8dfd1248ec9022f50fc108944e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Creating volume 042e5678-3904-47f5-abfc-dfd9ae011bea {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:17 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:17 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea 1073741824 Aug 26 19:03:17 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:18 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Flow 'volume_create_manager' (ac7f08a1-06e0-493b-8cf8-76474af26441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed753ea5-0401-4476-a3b8-a3480533c0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea 1073741824" returned: 0 in 0.598s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed753ea5-0401-4476-a3b8-a3480533c0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1527031592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13e5064-0b42-4e09-81fd-2c08ef9e6a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9411bd6e11454387a8ad35f624afd623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:18Z,use_quota=True,user_id='f207aff0ceb34b57b11f75860873fbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6cf5a2-9d26-442e-bb11-606a20c89005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6cf5a2-9d26-442e-bb11-606a20c89005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1e4a38-1139-4d25-ac57-798824ac33a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1e4a38-1139-4d25-ac57-798824ac33a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13e5064-0b42-4e09-81fd-2c08ef9e6a05', 'volume_name': 'volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9d175d-fff2-47c8-9b91-ca826ed4a127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9d175d-fff2-47c8-9b91-ca826ed4a127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60e638e-4765-4320-9d75-1b8b922c7a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:18 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Volume f13e5064-0b42-4e09-81fd-2c08ef9e6a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05', 'volume_size': 1} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:18 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea Aug 26 19:03:18 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:18 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea" returned: 0 in 0.271s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1527031592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13e5064-0b42-4e09-81fd-2c08ef9e6a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9411bd6e11454387a8ad35f624afd623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:18Z,use_quota=True,user_id='f207aff0ceb34b57b11f75860873fbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Creating volume f13e5064-0b42-4e09-81fd-2c08ef9e6a05 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:18 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f243192-4af7-4020-9017-a00255ecc623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042e5678-3904-47f5-abfc-dfd9ae011bea', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53503c34-ddbd-469d-882c-89fe24714670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:18 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 1073741824 Aug 26 19:03:18 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:18 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Volume volume-042e5678-3904-47f5-abfc-dfd9ae011bea (042e5678-3904-47f5-abfc-dfd9ae011bea): created successfully Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53503c34-ddbd-469d-882c-89fe24714670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Flow 'volume_create_manager' (c1540f2d-96fd-475f-9a93-dc8076c1e6cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:18 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-3efa9cac-fdde-41d5-b64f-0f569b7210f3 req-1ca4fc46-c89c-4b3c-b839-99e6ee7f63b6 tempest-VolumesGetTestJSON-122222146 None] Created volume successfully. Aug 26 19:03:18 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 1073741824" returned: 0 in 0.476s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:19 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 Aug 26 19:03:19 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:19 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05" returned: 0 in 0.366s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60e638e-4765-4320-9d75-1b8b922c7a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dd5cfa-2e20-4ee5-ad92-c5c4bd248f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:19 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Volume volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 (f13e5064-0b42-4e09-81fd-2c08ef9e6a05): created successfully Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dd5cfa-2e20-4ee5-ad92-c5c4bd248f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Flow 'volume_create_manager' (ac7f08a1-06e0-493b-8cf8-76474af26441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d9b77594-6476-40a6-93c8-769efab5e03a tempest-VolumesTransfersTest-599231264 None] Created volume successfully. Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Acquiring lock "cinder-042e5678-3904-47f5-abfc-dfd9ae011bea-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Lock "cinder-042e5678-3904-47f5-abfc-dfd9ae011bea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Acquiring lock "cinder-quobyte-042e5678-3904-47f5-abfc-dfd9ae011bea" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Lock "cinder-quobyte-042e5678-3904-47f5-abfc-dfd9ae011bea" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a412f331-ee27-4bb8-a044-47b44b1cb282]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:20 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea Aug 26 19:03:20 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:20 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea" returned: 0 in 0.557s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:20 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Acquiring lock "cinder-f13e5064-0b42-4e09-81fd-2c08ef9e6a05-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:20 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Lock "cinder-f13e5064-0b42-4e09-81fd-2c08ef9e6a05-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Acquiring lock "cinder-quobyte-f13e5064-0b42-4e09-81fd-2c08ef9e6a05" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Lock "cinder-quobyte-f13e5064-0b42-4e09-81fd-2c08ef9e6a05" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12629d6-f7e0-4994-9432-04583f7cc55d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:20 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 Aug 26 19:03:20 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:20 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-042e5678-3904-47f5-abfc-dfd9ae011bea" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Lock "cinder-quobyte-042e5678-3904-47f5-abfc-dfd9ae011bea" released by "delete_volume" :: held 1.005s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:20 devstack cinder-volume[93671]: DEBUG cinder.quota [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Created reservations ['f6de406b-88c2-488c-93f3-44c1ae3213b9', 'e68e4b6a-8dad-44b2-918e-a6579a9d5534', '8a995780-731b-412d-baae-1854fb198d5f', '53e1d995-368e-4090-bbdc-145bf300add1'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:21 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:21 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:21 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05" returned: 0 in 0.517s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:21 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05 Aug 26 19:03:21 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:21 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.307s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG cinder.manager [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Deleted volume successfully. Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-6d349a77-5ff0-4b6e-869b-43a8b3ac11af req-f02c1de6-96c2-474e-a484-8b21c57b460f tempest-VolumesGetTestJSON-122222146 None] Lock "cinder-042e5678-3904-47f5-abfc-dfd9ae011bea-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:21 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f13e5064-0b42-4e09-81fd-2c08ef9e6a05" returned: 0 in 0.324s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Lock "cinder-quobyte-f13e5064-0b42-4e09-81fd-2c08ef9e6a05" released by "delete_volume" :: held 0.908s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Created reservations ['ec5b1a4e-e51c-4f35-af8f-ef5d63bb4d5b', 'baff82f5-e9c9-4d8d-8a51-460e337b1088', '4282514a-be12-49e1-b283-014facd64c84', 'c5802ed4-2589-417b-b8e8-9c02afcea5d0'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:21 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:21 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:22 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.313s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:22 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Deleted volume successfully. Aug 26 19:03:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b8e04340-97e2-4b8d-8890-38955a2ed422 tempest-VolumesTransfersTest-918495541 None] Lock "cinder-f13e5064-0b42-4e09-81fd-2c08ef9e6a05-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Flow 'volume_create_manager' (b91c2f61-4b19-45de-ac09-2f6ea7cbbc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51994c0-acc7-45c7-8d59-801b2e44e017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51994c0-acc7-45c7-8d59-801b2e44e017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1354103652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7e3b0f-5b71-4cce-a475-b38b13dd124b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2272963009a54f56ba3735947488e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:28Z,use_quota=True,user_id='e52cb629ce6f46b29d8d575db4b4baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5adb903-88e0-4200-9156-6c225a8f0067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5adb903-88e0-4200-9156-6c225a8f0067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c651400-cb51-466b-8bb2-634daad3f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c651400-cb51-466b-8bb2-634daad3f187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7e3b0f-5b71-4cce-a475-b38b13dd124b', 'volume_name': 'volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ef4f3f-de1a-4db4-9f66-02878909411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ef4f3f-de1a-4db4-9f66-02878909411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad616cad-fe44-46f4-97d4-e8d39ece88d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:28 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Volume dc7e3b0f-5b71-4cce-a475-b38b13dd124b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b', 'volume_size': 1} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1354103652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7e3b0f-5b71-4cce-a475-b38b13dd124b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2272963009a54f56ba3735947488e315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:28Z,use_quota=True,user_id='e52cb629ce6f46b29d8d575db4b4baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Creating volume dc7e3b0f-5b71-4cce-a475-b38b13dd124b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:28 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:28 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b 1073741824 Aug 26 19:03:28 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Flow 'volume_create_manager' (5ec04c32-644b-4cda-919b-5b731b039b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe108bf-8123-4c8e-9b37-2b60e63d65e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe108bf-8123-4c8e-9b37-2b60e63d65e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-319015705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fbc3ea4-5449-4641-87f3-caa3b687133d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='478819e7d4d541c3b98511c7e553f334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:29Z,use_quota=True,user_id='452b1092a78141c18dadb42fe70b8ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c294e2cb-2cd3-4542-ba9d-4519ab3442f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c294e2cb-2cd3-4542-ba9d-4519ab3442f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109d0d5c-360b-4199-9f38-751034e7ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109d0d5c-360b-4199-9f38-751034e7ac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fbc3ea4-5449-4641-87f3-caa3b687133d', 'volume_name': 'volume-9fbc3ea4-5449-4641-87f3-caa3b687133d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64af9b7b-dbbd-4249-a7f0-ecdd0aa01be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64af9b7b-dbbd-4249-a7f0-ecdd0aa01be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c0aa40-b424-42a9-8711-7952cf1346ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Volume 9fbc3ea4-5449-4641-87f3-caa3b687133d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fbc3ea4-5449-4641-87f3-caa3b687133d', 'volume_size': 1} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:29 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b 1073741824" returned: 0 in 0.724s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:29 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b Aug 26 19:03:29 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Flow 'volume_create_manager' (87642980-ce4a-4ad7-b757-7fa18847c800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a924e2-759c-4230-83e7-996817a6389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a924e2-759c-4230-83e7-996817a6389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1603254289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3706cfb-d19e-4168-a97c-6285c06840e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c33e79c67e34dd79cb4042e501471f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:29Z,use_quota=True,user_id='08ee034ad22a4444bf8bb1e37a81ce57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7961b79-b947-4dc7-8cfc-4480cb359690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7961b79-b947-4dc7-8cfc-4480cb359690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f66f5a-d243-41d8-b0ae-9d3fb9e22063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 19:03:29 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" returned: 0 in 0.272s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.409s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-319015705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fbc3ea4-5449-4641-87f3-caa3b687133d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='478819e7d4d541c3b98511c7e553f334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:29Z,use_quota=True,user_id='452b1092a78141c18dadb42fe70b8ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Creating volume 9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:29 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad616cad-fe44-46f4-97d4-e8d39ece88d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d 1073741824 Aug 26 19:03:29 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36d5a95-943e-4904-8393-5e51f38cd6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Volume volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b (dc7e3b0f-5b71-4cce-a475-b38b13dd124b): created successfully Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36d5a95-943e-4904-8393-5e51f38cd6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Flow 'volume_create_manager' (b91c2f61-4b19-45de-ac09-2f6ea7cbbc59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e6c18c61-b1b3-4410-b6e9-f1e6e3b31888 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Created volume successfully. Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f66f5a-d243-41d8-b0ae-9d3fb9e22063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3706cfb-d19e-4168-a97c-6285c06840e6', 'volume_name': 'volume-d3706cfb-d19e-4168-a97c-6285c06840e6', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b48592b-70a8-4494-acf3-369c7e2c61cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b48592b-70a8-4494-acf3-369c7e2c61cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b45018-3804-4591-9272-9ba92af1cb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:29 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Volume d3706cfb-d19e-4168-a97c-6285c06840e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3706cfb-d19e-4168-a97c-6285c06840e6', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 19:03:29 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Trying to clone d3706cfb-d19e-4168-a97c-6285c06840e6 from image a20b2d73-0a49-4820-9be0-26e70205cff9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 19:03:30 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d 1073741824" returned: 0 in 0.555s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:30 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d Aug 26 19:03:30 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 19:03:30 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Image download 20.69 MB at 20.69 MB/s Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdddc5d-c1a5-4220-852c-2050ee0c78c9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:30 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD Aug 26 19:03:30 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:30 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d" returned: 0 in 0.278s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c0aa40-b424-42a9-8711-7952cf1346ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fbc3ea4-5449-4641-87f3-caa3b687133d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79e1185-8974-48d0-915f-5f9197b30d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:30 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Volume volume-9fbc3ea4-5449-4641-87f3-caa3b687133d (9fbc3ea4-5449-4641-87f3-caa3b687133d): created successfully Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79e1185-8974-48d0-915f-5f9197b30d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Flow 'volume_create_manager' (5ec04c32-644b-4cda-919b-5b731b039b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-003ff66f-1a1e-40da-91c2-2505ed81abd5 tempest-VolumesCloneTest-443688624 None] Created volume successfully. Aug 26 19:03:30 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 is fetched for user 08ee034ad22a4444bf8bb1e37a81ce57. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Creating offline snapshot d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 of volume dc7e3b0f-5b71-4cce-a475-b38b13dd124b {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[58963bc2-6554-4d5c-822d-46556cf1693e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e5d63f-afe9-49f1-bbab-5a0e4e6eb647]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:30 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b Aug 26 19:03:30 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:31 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD Aug 26 19:03:31 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:31 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" returned: 0 in 0.437s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:31 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:31 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 1G Aug 26 19:03:31 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:31 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 1G" returned: 0 in 0.478s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:31 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 Aug 26 19:03:31 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Flow 'volume_create_manager' (ed9e59b9-f2aa-48f6-aaaa-23477984d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b651b3da-e421-46f2-ae5d-d739623c4e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b651b3da-e421-46f2-ae5d-d739623c4e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1029454622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff06c3b3-db09-4826-ac21-d8593bd0af93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='478819e7d4d541c3b98511c7e553f334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9fbc3ea4-5449-4641-87f3-caa3b687133d,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:32Z,use_quota=True,user_id='452b1092a78141c18dadb42fe70b8ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edd2228-95dd-4484-aa4d-e4a40b8c7b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edd2228-95dd-4484-aa4d-e4a40b8c7b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff522e9-8658-4d75-988e-0da7e5b1be73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff522e9-8658-4d75-988e-0da7e5b1be73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ff06c3b3-db09-4826-ac21-d8593bd0af93', 'volume_name': 'volume-ff06c3b3-db09-4826-ac21-d8593bd0af93', 'volume_size': 2, 'source_volid': '9fbc3ea4-5449-4641-87f3-caa3b687133d', 'source_volstatus': 'available'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dad5f70-4fd8-4f54-9b26-a3e9a142a556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dad5f70-4fd8-4f54-9b26-a3e9a142a556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57792895-2547-4922-b90d-3d5ce5de6513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Volume ff06c3b3-db09-4826-ac21-d8593bd0af93: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ff06c3b3-db09-4826-ac21-d8593bd0af93', 'volume_size': 2, 'source_volid': '9fbc3ea4-5449-4641-87f3-caa3b687133d', 'source_volstatus': 'available'} Aug 26 19:03:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:32 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:32 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 is being set with open permissions: ugo+rw Aug 26 19:03:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:32 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 Aug 26 19:03:32 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:32 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9" returned: 0 in 0.270s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:32 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.info Aug 26 19:03:32 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:32 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.info" returned: 0 in 0.275s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:32 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.info is being set with open permissions: ugo+rw Aug 26 19:03:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:32 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.info Aug 26 19:03:32 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:32 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.info" returned: 0 in 0.291s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.676s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1603254289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3706cfb-d19e-4168-a97c-6285c06840e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c33e79c67e34dd79cb4042e501471f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:29Z,use_quota=True,user_id='08ee034ad22a4444bf8bb1e37a81ce57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Creating volume d3706cfb-d19e-4168-a97c-6285c06840e6 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:33 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:33 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 1073741824 Aug 26 19:03:33 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4d3eeb11-b90e-4f75-bc05-c1f6569a1496 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Create snapshot completed successfully Aug 26 19:03:33 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 1073741824" returned: 0 in 0.467s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:33 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 Aug 26 19:03:33 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:33 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6" returned: 0 in 0.281s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.825s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:33 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Cloning volume 9fbc3ea4-5449-4641-87f3-caa3b687133d to volume ff06c3b3-db09-4826-ac21-d8593bd0af93 Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Creating offline snapshot e372580f-1a74-4ca5-b4d0-35fcb17b988c of volume 9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Attempting download of a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume d3706cfb-d19e-4168-a97c-6285c06840e6. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[126f91a7-8434-4984-85b2-44f449c7253e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[afac2a4a-af89-4b03-a741-63d7cc335adb]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_1d_i6l2x {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:34 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d Aug 26 19:03:34 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:34 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_1d_i6l2x Aug 26 19:03:34 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:34 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d" returned: 0 in 0.517s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:34 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c 1G Aug 26 19:03:34 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:34 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_1d_i6l2x" returned: 0 in 0.576s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_1d_i6l2x {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Acquiring lock "cinder-d1db0ecb-9e82-4a12-868e-8d7a2affb5d9-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-d1db0ecb-9e82-4a12-868e-8d7a2affb5d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Acquiring lock "cinder-quobyte-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-quobyte-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Acquiring lock "cinder-quobyte-d1db0ecb-9e82-4a12-868e-8d7a2affb5d9" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-quobyte-d1db0ecb-9e82-4a12-868e-8d7a2affb5d9" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Deleting offline snapshot d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 of volume dc7e3b0f-5b71-4cce-a475-b38b13dd124b {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:03:34 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_1d_i6l2x Aug 26 19:03:34 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] snapshot_file for this snap is: volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b2968-67db-45b2-9183-c91cff41ffa2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:34 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 Aug 26 19:03:34 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:35 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_1d_i6l2x" returned: 1 in 0.620s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_1d_i6l2x' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c70913-9763-4f9b-9182-2a313d1ce86d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:35 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c 1G" returned: 0 in 0.771s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fbc3ea4-5449-4641-87f3-caa3b687133d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:35 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fbc3ea4-5449-4641-87f3-caa3b687133d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c Aug 26 19:03:35 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:35 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD Aug 26 19:03:35 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:35 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9" returned: 0 in 0.615s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9172d39f-8281-4ede-9fea-2da33a612a97]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:35 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b Aug 26 19:03:35 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-52003776-2ba6-4e58-955d-1a10567f6aa4 req-66ae2cf3-3cd8-4c02-a033-6b53578cbfb0 tempest-TestShelveInstance-2107740106 None] Terminate volume connection completed successfully. Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-52003776-2ba6-4e58-955d-1a10567f6aa4 req-66ae2cf3-3cd8-4c02-a033-6b53578cbfb0 tempest-TestShelveInstance-2107740106 None] Deleting attachment b2658d6d-e039-4542-8260-dbc36778c66f. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:03:35 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fbc3ea4-5449-4641-87f3-caa3b687133d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c" returned: 0 in 0.450s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:35 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c is being set with open permissions: ugo+rw Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:35 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c Aug 26 19:03:35 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:35 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] a20b2d73-0a49-4820-9be0-26e70205cff9 was qcow2, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:35 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 Aug 26 19:03:35 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:35 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" returned: 0 in 0.547s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:35 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c" returned: 0 in 0.339s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:35 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 Aug 26 19:03:35 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:36 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.info Aug 26 19:03:36 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:36 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9" returned: 0 in 0.412s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:36 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.info" returned: 0 in 0.349s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:36 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.info is being set with open permissions: ugo+rw Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:36 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9 Aug 26 19:03:36 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:36 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.info Aug 26 19:03:36 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:36 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b.d1db0ecb-9e82-4a12-868e-8d7a2affb5d9" returned: 0 in 0.278s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:36 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.info" returned: 0 in 0.283s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Acquiring lock "cinder-quobyte-ff06c3b3-db09-4826-ac21-d8593bd0af93" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-quobyte-d1db0ecb-9e82-4a12-868e-8d7a2affb5d9" released by "_delete_snapshot" :: held 2.069s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Lock "cinder-quobyte-ff06c3b3-db09-4826-ac21-d8593bd0af93" acquired by "_copy_volume_from_snapshot" :: waited 0.069s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] snapshot: e372580f-1a74-4ca5-b4d0-35fcb17b988c, volume: ff06c3b3-db09-4826-ac21-d8593bd0af93, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-quobyte-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" released by "delete_snapshot" :: held 2.157s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b34df33-249b-4e98-8ae2-56c4cdf1dad1]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Created reservations ['5563cc67-161d-4cdd-ad72-43527801576c', '9eea7f50-6fea-4563-9a30-93bde1fd7314', '95963a09-130d-4a6d-85e7-18ddbe559502', '0bb26bbe-86d3-41cb-b979-d7c9866437c7'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:36 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Delete snapshot completed successfully. Aug 26 19:03:36 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c Aug 26 19:03:36 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4a2b1df-7b21-4cba-823b-7f8786cc54e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-d1db0ecb-9e82-4a12-868e-8d7a2affb5d9-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:37 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c" returned: 0 in 0.535s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fbc3ea4-5449-4641-87f3-caa3b687133d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3edfb8b-c682-432a-b98d-f7ac95215af5]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:37 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d Aug 26 19:03:37 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:37 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d" returned: 0 in 0.461s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:37 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 Aug 26 19:03:37 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:37 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Acquiring lock "cinder-dc7e3b0f-5b71-4cce-a475-b38b13dd124b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6" returned: 0 in 2.263s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_xi1g9tbbdevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:03:37 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Converted 112.00 MB image at 49.47 MB/s Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-dc7e3b0f-5b71-4cce-a475-b38b13dd124b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:38 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 1G Aug 26 19:03:38 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Acquiring lock "cinder-quobyte-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-quobyte-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" acquired by "delete_volume" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d2363d-796d-4827-a5bb-c6d7edbe6497]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:38 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b Aug 26 19:03:38 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:38 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 1G" returned: 0 in 0.473s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Downloaded image a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume d3706cfb-d19e-4168-a97c-6285c06840e6 successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 for user 08ee034ad22a4444bf8bb1e37a81ce57 is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Marking volume d3706cfb-d19e-4168-a97c-6285c06840e6 as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Copying metadata from image a20b2d73-0a49-4820-9be0-26e70205cff9 to d3706cfb-d19e-4168-a97c-6285c06840e6. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Creating volume glance metadata for volume d3706cfb-d19e-4168-a97c-6285c06840e6 backed by image a20b2d73-0a49-4820-9be0-26e70205cff9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b45018-3804-4591-9272-9ba92af1cb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3706cfb-d19e-4168-a97c-6285c06840e6', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87c1646-8fd5-4aef-bb83-1ef0154550e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:38 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Volume volume-d3706cfb-d19e-4168-a97c-6285c06840e6 (d3706cfb-d19e-4168-a97c-6285c06840e6): created successfully Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87c1646-8fd5-4aef-bb83-1ef0154550e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Flow 'volume_create_manager' (87642980-ce4a-4ad7-b757-7fa18847c800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ef8bfd0d-0c38-49e1-b096-82df06bc1e29 tempest-VolumesImageMetadata-758562739 None] Created volume successfully. Aug 26 19:03:38 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" returned: 0 in 0.657s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:38 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b Aug 26 19:03:38 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-210ad970-c1fd-4f07-85f8-5d1906128410 req-39849ae2-3006-4708-af3c-f1649b18a576 tempest-TestShelveInstance-2107740106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:39 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" returned: 0 in 0.672s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-quobyte-dc7e3b0f-5b71-4cce-a475-b38b13dd124b" released by "delete_volume" :: held 1.451s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:39 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Created reservations ['d9cf13ed-cbaa-49c0-b00f-42277e92ea68', '73cbe48d-67df-4685-8376-139c43648f84', '83014c3c-96ba-44be-bb20-71e7fe37fc94', '6dab80b7-8e5a-4743-a45e-576864fdf72d'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:40 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:40 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Acquiring lock "cinder-d3706cfb-d19e-4168-a97c-6285c06840e6-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Lock "cinder-d3706cfb-d19e-4168-a97c-6285c06840e6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Acquiring lock "cinder-quobyte-d3706cfb-d19e-4168-a97c-6285c06840e6" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Lock "cinder-quobyte-d3706cfb-d19e-4168-a97c-6285c06840e6" acquired by "delete_volume" :: waited 0.050s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e868b-4af6-4f44-9635-aba613495dbc]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:40 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.823s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:40 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Deleted volume successfully. Aug 26 19:03:40 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 Aug 26 19:03:40 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b90e8144-62c3-4c49-993c-40836fae457b tempest-VolumeSnapshotQuotasNegativeTestJSON-1340482671 None] Lock "cinder-dc7e3b0f-5b71-4cce-a475-b38b13dd124b-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:41 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6" returned: 0 in 0.804s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:41 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6 Aug 26 19:03:41 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:42 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d3706cfb-d19e-4168-a97c-6285c06840e6" returned: 0 in 0.904s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Lock "cinder-quobyte-d3706cfb-d19e-4168-a97c-6285c06840e6" released by "delete_volume" :: held 1.861s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:42 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Created reservations ['f0d91eb9-b5cb-45a1-8a03-557880b116cc', 'c51b4eab-9691-4451-ab18-774d7270590f', '42a62f4a-8a74-485c-a6be-a2e46613a6c0', '5d3356c0-6e56-4c7f-b9cb-f39e8aa7d5ea'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:42 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:42 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:43 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.776s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:43 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:43 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Deleted volume successfully. Aug 26 19:03:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0db18efa-4c14-4793-b88f-71a913b45e46 tempest-VolumesImageMetadata-758562739 None] Lock "cinder-d3706cfb-d19e-4168-a97c-6285c06840e6-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:44 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93" returned: 0 in 6.278s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:03:44 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Converted 1024.00 MB image at 163.05 MB/s Aug 26 19:03:44 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 is being set with open permissions: ugo+rw Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:44 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 Aug 26 19:03:44 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:44 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93" returned: 0 in 0.292s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Lock "cinder-quobyte-ff06c3b3-db09-4826-ac21-d8593bd0af93" released by "_copy_volume_from_snapshot" :: held 7.658s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Acquiring lock "cinder-quobyte-e372580f-1a74-4ca5-b4d0-35fcb17b988c" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Lock "cinder-quobyte-e372580f-1a74-4ca5-b4d0-35fcb17b988c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Deleting offline snapshot e372580f-1a74-4ca5-b4d0-35fcb17b988c of volume 9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] snapshot_file for this snap is: volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[50970175-e12d-48a9-8488-7ad2e25015b1]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:44 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c Aug 26 19:03:44 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:44 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c" returned: 0 in 0.411s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fbc3ea4-5449-4641-87f3-caa3b687133d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa2f249-4497-4c18-9766-232461f03478]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:45 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d Aug 26 19:03:45 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:45 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d" returned: 0 in 0.612s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:45 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c Aug 26 19:03:45 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:45 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c" returned: 0 in 0.424s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:46 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c Aug 26 19:03:46 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:46 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d.e372580f-1a74-4ca5-b4d0-35fcb17b988c" returned: 0 in 0.267s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Lock "cinder-quobyte-e372580f-1a74-4ca5-b4d0-35fcb17b988c" released by "_delete_snapshot" :: held 1.857s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.544s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-210ad970-c1fd-4f07-85f8-5d1906128410 req-39849ae2-3006-4708-af3c-f1649b18a576 tempest-TestShelveInstance-2107740106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.228s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-210ad970-c1fd-4f07-85f8-5d1906128410 req-39849ae2-3006-4708-af3c-f1649b18a576 tempest-TestShelveInstance-2107740106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57792895-2547-4922-b90d-3d5ce5de6513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff06c3b3-db09-4826-ac21-d8593bd0af93', 'volume_size': 2, 'source_volid': '9fbc3ea4-5449-4641-87f3-caa3b687133d', 'source_volstatus': 'available'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a59d04-87be-4148-b811-d07411ed3ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:46 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Volume volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 (ff06c3b3-db09-4826-ac21-d8593bd0af93): created successfully Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a59d04-87be-4148-b811-d07411ed3ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Flow 'volume_create_manager' (ed9e59b9-f2aa-48f6-aaaa-23477984d53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-84aeb0fc-e42b-4bb5-82c0-97ac12163359 tempest-VolumesCloneTest-443688624 None] Created volume successfully. Aug 26 19:03:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-210ad970-c1fd-4f07-85f8-5d1906128410 req-39849ae2-3006-4708-af3c-f1649b18a576 tempest-TestShelveInstance-2107740106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-42a8024f-4ac6-405b-adbc-e519c9a4331d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca221267-b8bd-46b2-97e4-5f5641bbe593', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:03:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-210ad970-c1fd-4f07-85f8-5d1906128410 req-39849ae2-3006-4708-af3c-f1649b18a576 tempest-TestShelveInstance-2107740106 None] attachment_update completed successfully. Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Acquiring lock "cinder-ff06c3b3-db09-4826-ac21-d8593bd0af93-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Lock "cinder-ff06c3b3-db09-4826-ac21-d8593bd0af93-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (bd49671a-483f-4ba3-92fd-fa7fc983c812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf665f7-37d0-4b97-b83c-0b17f35cba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf665f7-37d0-4b97-b83c-0b17f35cba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1527257431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484bd8e1-5c78-4f00-8645-d30812e971ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:47Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f574975-a8fc-47b3-828a-71623fb70cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f574975-a8fc-47b3-828a-71623fb70cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963fff7f-94e0-4d36-8ef3-4c1ab92e812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963fff7f-94e0-4d36-8ef3-4c1ab92e812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484bd8e1-5c78-4f00-8645-d30812e971ea', 'volume_name': 'volume-484bd8e1-5c78-4f00-8645-d30812e971ea', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bf41d7-8904-41ed-a66f-0e1c247d2e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01bf41d7-8904-41ed-a66f-0e1c247d2e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0546fdb-04e8-49bf-bf34-ec8812acd440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:47 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Volume 484bd8e1-5c78-4f00-8645-d30812e971ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484bd8e1-5c78-4f00-8645-d30812e971ea', 'volume_size': 1} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1527257431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484bd8e1-5c78-4f00-8645-d30812e971ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:47Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Creating volume 484bd8e1-5c78-4f00-8645-d30812e971ea {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:47 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:47 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea 1073741824 Aug 26 19:03:47 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Acquiring lock "cinder-quobyte-ff06c3b3-db09-4826-ac21-d8593bd0af93" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Lock "cinder-quobyte-ff06c3b3-db09-4826-ac21-d8593bd0af93" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[333773cc-dd78-49b3-ad42-707c5fb26485]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:47 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 Aug 26 19:03:47 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:48 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93" returned: 0 in 0.497s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:48 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93 Aug 26 19:03:48 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:48 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea 1073741824" returned: 0 in 0.677s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:48 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea Aug 26 19:03:48 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:48 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff06c3b3-db09-4826-ac21-d8593bd0af93" returned: 0 in 0.354s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Lock "cinder-quobyte-ff06c3b3-db09-4826-ac21-d8593bd0af93" released by "delete_volume" :: held 0.908s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Created reservations ['fb54e86b-2690-4395-99af-9751c719ec17', 'f5858b96-bd4f-4886-beba-de532ec60533', 'f6336d80-f71e-4ce3-8792-66d638159f28', 'ad7cfcf8-6861-40e0-b6fd-01c6341ce2ad'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:48 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea" returned: 0 in 0.332s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0546fdb-04e8-49bf-bf34-ec8812acd440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484bd8e1-5c78-4f00-8645-d30812e971ea', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0e65c7-3481-4e71-baba-8452fe957e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:48 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Volume volume-484bd8e1-5c78-4f00-8645-d30812e971ea (484bd8e1-5c78-4f00-8645-d30812e971ea): created successfully Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc0e65c7-3481-4e71-baba-8452fe957e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (bd49671a-483f-4ba3-92fd-fa7fc983c812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c90d5f6b-01d5-46d7-af20-81f2980dfd66 tempest-VolumesGetTest-1068532465 None] Created volume successfully. Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:48 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:48 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:49 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.313s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:49 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:49 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Deleted volume successfully. Aug 26 19:03:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4bd05f7-ce64-4a2c-a16b-ab6acc60166e tempest-VolumesCloneTest-443688624 None] Lock "cinder-ff06c3b3-db09-4826-ac21-d8593bd0af93-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Acquiring lock "cinder-9fbc3ea4-5449-4641-87f3-caa3b687133d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Lock "cinder-9fbc3ea4-5449-4641-87f3-caa3b687133d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Acquiring lock "cinder-quobyte-9fbc3ea4-5449-4641-87f3-caa3b687133d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Lock "cinder-quobyte-9fbc3ea4-5449-4641-87f3-caa3b687133d" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:50 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c69bf3-1c6f-4588-b42a-9d43bdfa8f4e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:50 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d Aug 26 19:03:50 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:50 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d" returned: 0 in 0.637s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:50 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d Aug 26 19:03:50 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (0941a6db-9bab-412d-b794-7a6d7a876a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23b0957-6f0b-4134-88fd-8ded7ebac724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23b0957-6f0b-4134-88fd-8ded7ebac724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1593777277',display_name='tempest-VolumesGetTest-Volume-232007684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b562f2f-7e41-42bf-8687-6badb7161c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:51Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b869b6d-9e19-462b-8a1c-9f6a9fbad201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b869b6d-9e19-462b-8a1c-9f6a9fbad201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db7fb67-316f-4fd9-99fa-c0e0f0f6cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db7fb67-316f-4fd9-99fa-c0e0f0f6cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b562f2f-7e41-42bf-8687-6badb7161c31', 'volume_name': 'volume-2b562f2f-7e41-42bf-8687-6badb7161c31', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd626e1e-30de-45ad-967a-86278c928780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd626e1e-30de-45ad-967a-86278c928780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a5e0e6-0672-4b7c-a15e-1af1b7bbc91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:51 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Volume 2b562f2f-7e41-42bf-8687-6badb7161c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b562f2f-7e41-42bf-8687-6badb7161c31', 'volume_size': 1} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1593777277',display_name='tempest-VolumesGetTest-Volume-232007684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b562f2f-7e41-42bf-8687-6badb7161c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:51Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Creating volume 2b562f2f-7e41-42bf-8687-6badb7161c31 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:51 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:51 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9fbc3ea4-5449-4641-87f3-caa3b687133d" returned: 0 in 0.565s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:51 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31 1073741824 Aug 26 19:03:51 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Lock "cinder-quobyte-9fbc3ea4-5449-4641-87f3-caa3b687133d" released by "delete_volume" :: held 1.344s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Created reservations ['f633ffa2-ae33-45ae-b1a8-5909f5a65f70', 'bab3caa1-e0e8-4711-ade5-c07cfdaf7042', 'f50f1293-62f2-4181-8bd1-811a43cfe4b9', '869523ce-d356-4408-bd09-eeb952e9b464'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:51 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:51 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:51 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31 1073741824" returned: 0 in 0.552s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:51 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.351s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Deleted volume successfully. Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-130ce89f-fb4a-4238-8c06-7056f82e95e6 tempest-VolumesCloneTest-443688624 None] Lock "cinder-9fbc3ea4-5449-4641-87f3-caa3b687133d-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:52 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31 Aug 26 19:03:52 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:52 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31" returned: 0 in 0.394s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a5e0e6-0672-4b7c-a15e-1af1b7bbc91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b562f2f-7e41-42bf-8687-6badb7161c31', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1688e6-f0b4-449d-9e7a-3f888c92e2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:52 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Volume volume-2b562f2f-7e41-42bf-8687-6badb7161c31 (2b562f2f-7e41-42bf-8687-6badb7161c31): created successfully Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1688e6-f0b4-449d-9e7a-3f888c92e2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (0941a6db-9bab-412d-b794-7a6d7a876a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-63d4e6f2-6d28-47ef-bcfc-ca397a05262a tempest-VolumesGetTest-1068532465 None] Created volume successfully. Aug 26 19:03:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-2b562f2f-7e41-42bf-8687-6badb7161c31-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Lock "cinder-2b562f2f-7e41-42bf-8687-6badb7161c31-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-quobyte-2b562f2f-7e41-42bf-8687-6badb7161c31" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-2b562f2f-7e41-42bf-8687-6badb7161c31" acquired by "delete_volume" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:53 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2e4a81-7538-468b-9107-0d3b4f432187]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:53 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31 Aug 26 19:03:53 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:54 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31" returned: 0 in 0.508s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:54 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31 Aug 26 19:03:54 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:54 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:54 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:54 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2b562f2f-7e41-42bf-8687-6badb7161c31" returned: 0 in 0.429s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-2b562f2f-7e41-42bf-8687-6badb7161c31" released by "delete_volume" :: held 1.011s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:54 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Created reservations ['d50904fa-d012-49c7-8003-6714432d9a50', '3a3ddfe0-8272-47cf-8519-532f06d83ab2', 'ebe416b3-fa89-4c23-81f7-7b7d627f8c19', 'a11352bc-f707-4c75-8605-a2e88f5cdadf'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:55 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.517s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:55 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:55 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:55 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.499s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Deleted volume successfully. Aug 26 19:03:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-08846729-0752-4372-b913-3c62bdde5a50 tempest-VolumesGetTest-1068532465 None] Lock "cinder-2b562f2f-7e41-42bf-8687-6badb7161c31-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-484bd8e1-5c78-4f00-8645-d30812e971ea-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Lock "cinder-484bd8e1-5c78-4f00-8645-d30812e971ea-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-quobyte-484bd8e1-5c78-4f00-8645-d30812e971ea" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-484bd8e1-5c78-4f00-8645-d30812e971ea" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:03:56 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[24baccad-5e77-4434-89f9-28ce6900f49d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:03:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:56 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea Aug 26 19:03:56 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:56 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea" returned: 0 in 0.529s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:56 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea Aug 26 19:03:56 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:57 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-484bd8e1-5c78-4f00-8645-d30812e971ea" returned: 0 in 0.384s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-484bd8e1-5c78-4f00-8645-d30812e971ea" released by "delete_volume" :: held 0.988s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Created reservations ['2f34580c-8637-4f85-b69d-7cc90764c38c', 'e802c67d-1cf7-4d4c-ba12-aa64f4c06e7f', '2cbc1f82-936b-44c8-8251-fa69f7077ddb', 'd978a22a-d3e0-4bf8-8104-a5e93ac9f809'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Flow 'volume_create_manager' (6c037438-3c44-4506-85c4-babace98d692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d90cf3-d153-404f-9537-a36d5dc6d089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d90cf3-d153-404f-9537-a36d5dc6d089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-25330284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa36a75-cd25-4d36-98da-1bcbf80e4f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c64aea90a0d4d16b39158fd8205597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:57Z,use_quota=True,user_id='b03d79aac67c4b9e8784506b23bfbda6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654ab458-841c-43b7-abaf-96c6cb941a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654ab458-841c-43b7-abaf-96c6cb941a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff65645-dfc6-4f44-9690-edcf8f149df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff65645-dfc6-4f44-9690-edcf8f149df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa36a75-cd25-4d36-98da-1bcbf80e4f7e', 'volume_name': 'volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e', 'volume_size': 2}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3969e306-0806-47d2-ac3b-6edf376a5cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3969e306-0806-47d2-ac3b-6edf376a5cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d70193-30e0-4f9a-afbc-b90504e1084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:57 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Volume aaa36a75-cd25-4d36-98da-1bcbf80e4f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e', 'volume_size': 2} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-25330284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa36a75-cd25-4d36-98da-1bcbf80e4f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c64aea90a0d4d16b39158fd8205597b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:57Z,use_quota=True,user_id='b03d79aac67c4b9e8784506b23bfbda6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Creating volume aaa36a75-cd25-4d36-98da-1bcbf80e4f7e {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:57 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e 2147483648 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=107,cinder:UPDATE=136,cinder:DELETE=11,cinder:INSERT=36 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=135,cinder:SELECT=115,cinder:INSERT=42,cinder:DELETE=12 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:03:57 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e 2147483648 Aug 26 19:03:57 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:57 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:03:57 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:58 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.418s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:03:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Deleted volume successfully. Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-edf1e374-7917-40f9-941d-0c7470316412 tempest-VolumesGetTest-1068532465 None] Lock "cinder-484bd8e1-5c78-4f00-8645-d30812e971ea-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:03:58 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e 2147483648" returned: 0 in 0.658s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:58 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e Aug 26 19:03:58 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:58 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e" returned: 0 in 0.359s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d70193-30e0-4f9a-afbc-b90504e1084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e', 'volume_size': 2}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af379c1a-c8dd-4a9f-941a-080b2be05f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:58 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Volume volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e (aaa36a75-cd25-4d36-98da-1bcbf80e4f7e): created successfully Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af379c1a-c8dd-4a9f-941a-080b2be05f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Flow 'volume_create_manager' (6c037438-3c44-4506-85c4-babace98d692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8df8d3f5-395d-4fd6-803f-38a42e2b1850 tempest-VolumesCloneNegativeTest-1154886659 None] Created volume successfully. Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (29257f32-83af-4259-b800-14ce72bac307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9f6012-a643-4be5-b1b3-6f384be72d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9f6012-a643-4be5-b1b3-6f384be72d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1583248173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0902b98-758c-404e-9ea5-97106245237e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:59Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5141c9a1-0434-4fb8-a097-11ceea1918af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5141c9a1-0434-4fb8-a097-11ceea1918af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509b6807-69a2-403e-8b44-6db84b4bf81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509b6807-69a2-403e-8b44-6db84b4bf81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0902b98-758c-404e-9ea5-97106245237e', 'volume_name': 'volume-d0902b98-758c-404e-9ea5-97106245237e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e55759c-b5d0-4fd3-b80a-37ce04f173b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e55759c-b5d0-4fd3-b80a-37ce04f173b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0764aff-e137-4ec5-8729-dd8a84093f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:03:59 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Volume d0902b98-758c-404e-9ea5-97106245237e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0902b98-758c-404e-9ea5-97106245237e', 'volume_size': 1} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1583248173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0902b98-758c-404e-9ea5-97106245237e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:03:59Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Creating volume d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:03:59 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:03:59 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e 1073741824 Aug 26 19:03:59 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Acquiring lock "cinder-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:03:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "cinder-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Acquiring lock "cinder-quobyte-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "cinder-quobyte-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1472320-f5cb-4362-b02e-36eb1036db05]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:00 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e 1073741824" returned: 0 in 0.817s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:00 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e Aug 26 19:04:00 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:00 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e Aug 26 19:04:00 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:00 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e" returned: 0 in 0.309s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0764aff-e137-4ec5-8729-dd8a84093f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0902b98-758c-404e-9ea5-97106245237e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7352193-99f8-4d72-9194-8d8c9534b13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:00 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Volume volume-d0902b98-758c-404e-9ea5-97106245237e (d0902b98-758c-404e-9ea5-97106245237e): created successfully Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7352193-99f8-4d72-9194-8d8c9534b13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (29257f32-83af-4259-b800-14ce72bac307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:00 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e" returned: 0 in 0.624s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:00 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-13a4ac83-a721-4b4a-a27f-a17df0b7d83d tempest-VolumesGetTest-1068532465 None] Created volume successfully. Aug 26 19:04:00 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e Aug 26 19:04:00 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:00 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e" returned: 0 in 0.269s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "cinder-quobyte-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e" released by "delete_volume" :: held 0.963s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Created reservations ['ccb007d8-9078-4b83-bc6b-b0af4972dc1d', 'a8665374-5cd9-4d6d-afa2-7a5224e965c9', '59e8f158-e90e-4cd4-aaf9-d9a25679812e', 'd645a172-1d36-4fbe-ba86-bff88a595ea0'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:01 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:01 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:01 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.342s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:01 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Deleted volume successfully. Aug 26 19:04:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-74c817a7-6ee0-4c92-816f-d02759cbef70 tempest-VolumesCloneNegativeTest-1154886659 None] Lock "cinder-aaa36a75-cd25-4d36-98da-1bcbf80e4f7e-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (85b69a45-c280-4ed1-8aa8-1f4f97030e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0d059e-f4cf-4160-b66a-51ef15a6f915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0d059e-f4cf-4160-b66a-51ef15a6f915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-389272325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01c416e-a674-4af4-8b62-3ab8cd88b2a5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d0902b98-758c-404e-9ea5-97106245237e,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:02Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559470a8-ef3b-462b-8c83-3038e72433f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559470a8-ef3b-462b-8c83-3038e72433f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f25c9d-137c-4e06-836a-694826d68cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f25c9d-137c-4e06-836a-694826d68cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f01c416e-a674-4af4-8b62-3ab8cd88b2a5', 'volume_name': 'volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5', 'volume_size': 1, 'source_volid': 'd0902b98-758c-404e-9ea5-97106245237e', 'source_volstatus': 'available'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2027d65d-9dd9-4485-af50-bc5377a31df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2027d65d-9dd9-4485-af50-bc5377a31df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c47044-41cc-4398-a67b-2bc0b57ea778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:02 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Volume f01c416e-a674-4af4-8b62-3ab8cd88b2a5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5', 'volume_size': 1, 'source_volid': 'd0902b98-758c-404e-9ea5-97106245237e', 'source_volstatus': 'available'} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:02 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Cloning volume d0902b98-758c-404e-9ea5-97106245237e to volume f01c416e-a674-4af4-8b62-3ab8cd88b2a5 Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Creating offline snapshot f3cb4475-dca7-48b6-862b-663b353b8162 of volume d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dba9b2-0682-441c-80dc-7007dc2ad944]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:02 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e Aug 26 19:04:02 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:02 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e" returned: 0 in 0.463s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:02 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 1G Aug 26 19:04:02 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:03 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 1G" returned: 0 in 0.636s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0902b98-758c-404e-9ea5-97106245237e -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:03 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0902b98-758c-404e-9ea5-97106245237e -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 Aug 26 19:04:03 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:03 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0902b98-758c-404e-9ea5-97106245237e -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162" returned: 0 in 0.497s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:03 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 is being set with open permissions: ugo+rw Aug 26 19:04:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:03 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 Aug 26 19:04:03 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:04 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162" returned: 0 in 0.407s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:04 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.info Aug 26 19:04:04 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Flow 'volume_create_manager' (8ee22d75-60ea-4f46-8cb8-05538210525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36c01bb-a0b0-4dd3-b261-b3916ba6e361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36c01bb-a0b0-4dd3-b261-b3916ba6e361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2091653694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2effe9-007e-4685-a964-d456ca73106b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e51f93af674f5c98f40705be7255cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:05Z,use_quota=True,user_id='9d89fde072564985aff6bc4738fe9b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe0d8bb-5aeb-4374-b9a0-fa652ee8bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe0d8bb-5aeb-4374-b9a0-fa652ee8bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d47cc4-baf9-405b-9f90-b933832d87cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d47cc4-baf9-405b-9f90-b933832d87cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2effe9-007e-4685-a964-d456ca73106b', 'volume_name': 'volume-fa2effe9-007e-4685-a964-d456ca73106b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918a3bda-1906-49aa-b6e9-a6c833f60730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918a3bda-1906-49aa-b6e9-a6c833f60730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6ec0de-72b8-4cd5-a1ab-13adedfe4a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:04 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Volume fa2effe9-007e-4685-a964-d456ca73106b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2effe9-007e-4685-a964-d456ca73106b', 'volume_size': 1} Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:04 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.info" returned: 0 in 0.465s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:04 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.info is being set with open permissions: ugo+rw Aug 26 19:04:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:04 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.info Aug 26 19:04:04 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:05 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.info" returned: 0 in 0.284s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-quobyte-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] snapshot: f3cb4475-dca7-48b6-862b-663b353b8162, volume: f01c416e-a674-4af4-8b62-3ab8cd88b2a5, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0a60b7-762f-4872-b3c4-f5474f6af9ee]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:05 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 Aug 26 19:04:05 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:05 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162" returned: 0 in 0.438s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0902b98-758c-404e-9ea5-97106245237e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[53510545-5183-43dc-a892-1cc332775d6f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:05 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e Aug 26 19:04:05 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:06 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e" returned: 0 in 0.395s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:06 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 Aug 26 19:04:06 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Flow 'volume_create_manager' (43714b8e-67a3-485c-b9dd-f1e95794fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d24cc0b-4123-49d1-adc0-aa9865d2ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d24cc0b-4123-49d1-adc0-aa9865d2ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-75952874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61592d7e-85c4-42bf-8141-576667172f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ecbf96f75848f0b33521cd89c43963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:07Z,use_quota=True,user_id='8e96159d4f8a4e198521ba2f5b50fd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f732292c-e7da-42bc-bb49-1652bba10bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:06 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f732292c-e7da-42bc-bb49-1652bba10bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8147f826-100e-4c7f-b535-4b0eee578cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:07 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 19:04:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8147f826-100e-4c7f-b535-4b0eee578cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '61592d7e-85c4-42bf-8141-576667172f1b', 'volume_name': 'volume-61592d7e-85c4-42bf-8141-576667172f1b', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0ffae3-1099-4077-90f8-a3f9527c545f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0ffae3-1099-4077-90f8-a3f9527c545f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29811230-f442-4a6d-a7b8-54dd2138b8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:07 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Volume 61592d7e-85c4-42bf-8141-576667172f1b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-61592d7e-85c4-42bf-8141-576667172f1b', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 19:04:07 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Trying to clone 61592d7e-85c4-42bf-8141-576667172f1b from image a20b2d73-0a49-4820-9be0-26e70205cff9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 19:04:09 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD, size 20.69 MB, duration 1.20 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 19:04:09 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Image download 20.69 MB at 17.28 MB/s Aug 26 19:04:09 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[239e0eb8-3606-4019-b3b4-d59e75f0dd6f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:09 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD Aug 26 19:04:09 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:10 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD" returned: 0 in 1.112s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:10 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 is fetched for user 8e96159d4f8a4e198521ba2f5b50fd6e. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 19:04:10 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2dfe86-c010-45e4-8b54-68f84c323905]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:10 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD Aug 26 19:04:10 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:11 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD" returned: 0 in 0.658s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:11 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" returned: 0 in 5.829s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:11 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:04:11 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Converted 1024.00 MB image at 175.64 MB/s Aug 26 19:04:11 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 is being set with open permissions: ugo+rw Aug 26 19:04:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:11 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 Aug 26 19:04:11 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:12 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" returned: 0 in 0.249s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" released by "_copy_volume_from_snapshot" :: held 6.994s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-quobyte-f3cb4475-dca7-48b6-862b-663b353b8162" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-f3cb4475-dca7-48b6-862b-663b353b8162" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Deleting offline snapshot f3cb4475-dca7-48b6-862b-663b353b8162 of volume d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] snapshot_file for this snap is: volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e91147-a454-40c1-bd07-83059d3da97c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:12 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 Aug 26 19:04:12 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:12 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162" returned: 0 in 0.364s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0902b98-758c-404e-9ea5-97106245237e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6612839f-1707-447e-9e6f-e722ec565f13]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:12 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e Aug 26 19:04:12 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:13 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e" returned: 0 in 0.509s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:13 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 Aug 26 19:04:13 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:13 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162" returned: 0 in 0.355s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:13 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162 Aug 26 19:04:13 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:13 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e.f3cb4475-dca7-48b6-862b-663b353b8162" returned: 0 in 0.257s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-f3cb4475-dca7-48b6-862b-663b353b8162" released by "_delete_snapshot" :: held 1.581s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.599s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.033s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2091653694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2effe9-007e-4685-a964-d456ca73106b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e51f93af674f5c98f40705be7255cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:05Z,use_quota=True,user_id='9d89fde072564985aff6bc4738fe9b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Creating volume fa2effe9-007e-4685-a964-d456ca73106b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:13 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c47044-41cc-4398-a67b-2bc0b57ea778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5', 'volume_size': 1, 'source_volid': 'd0902b98-758c-404e-9ea5-97106245237e', 'source_volstatus': 'available'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:13 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b 1073741824 Aug 26 19:04:13 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a6d939-e126-4111-894b-0d5ccaa15f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Volume volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 (f01c416e-a674-4af4-8b62-3ab8cd88b2a5): created successfully Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a6d939-e126-4111-894b-0d5ccaa15f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (85b69a45-c280-4ed1-8aa8-1f4f97030e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b68208a5-dc1f-4149-b8be-52dc5b482699 tempest-VolumesGetTest-1068532465 None] Created volume successfully. Aug 26 19:04:14 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b 1073741824" returned: 0 in 0.437s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:14 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b Aug 26 19:04:14 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:14 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b" returned: 0 in 0.261s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.333s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-75952874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61592d7e-85c4-42bf-8141-576667172f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ecbf96f75848f0b33521cd89c43963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:07Z,use_quota=True,user_id='8e96159d4f8a4e198521ba2f5b50fd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Creating volume 61592d7e-85c4-42bf-8141-576667172f1b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:14 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6ec0de-72b8-4cd5-a1ab-13adedfe4a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2effe9-007e-4685-a964-d456ca73106b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:14 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b 1073741824 Aug 26 19:04:14 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3bc21f-1ae7-4f6f-b141-e75f1ab0fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:14 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Volume volume-fa2effe9-007e-4685-a964-d456ca73106b (fa2effe9-007e-4685-a964-d456ca73106b): created successfully Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3bc21f-1ae7-4f6f-b141-e75f1ab0fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Flow 'volume_create_manager' (8ee22d75-60ea-4f46-8cb8-05538210525f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2630247e-47fc-4dea-9a9f-2a952188bf6b tempest-VolumesTransfersV355Test-1537075033 None] Created volume successfully. Aug 26 19:04:15 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b 1073741824" returned: 0 in 0.583s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:15 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b Aug 26 19:04:15 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (6b03f979-2a4f-4911-bce6-ffb8ab06b084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14602962-f96d-4342-b477-909a553f146c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14602962-f96d-4342-b477-909a553f146c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1945794514',display_name='tempest-VolumesGetTest-Volume-441188043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeba1ff-f494-487c-b39f-1f97453a74f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:15Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec311a6-4215-45a9-9181-0432de2e9363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec311a6-4215-45a9-9181-0432de2e9363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef53d31-dc0e-4361-a610-148f6c611cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef53d31-dc0e-4361-a610-148f6c611cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eeba1ff-f494-487c-b39f-1f97453a74f4', 'volume_name': 'volume-2eeba1ff-f494-487c-b39f-1f97453a74f4', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ab0046-e91f-4629-b36a-6a6b06ed8c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ab0046-e91f-4629-b36a-6a6b06ed8c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b536fb-3bfa-40ef-81a6-344dc9139a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:15 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Volume 2eeba1ff-f494-487c-b39f-1f97453a74f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eeba1ff-f494-487c-b39f-1f97453a74f4', 'volume_size': 1} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:15 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b" returned: 0 in 0.271s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1945794514',display_name='tempest-VolumesGetTest-Volume-441188043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eeba1ff-f494-487c-b39f-1f97453a74f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:15Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Creating volume 2eeba1ff-f494-487c-b39f-1f97453a74f4 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:15 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:15 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 1073741824 Aug 26 19:04:15 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Attempting download of a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume 61592d7e-85c4-42bf-8141-576667172f1b. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d2f83-57d8-445e-a545-27fb87896584]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_hd4l276m {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2b4d7158-0fdd-43f0-915e-b98232a8d1d0 tempest-VolumesTransfersV355Test-2135633895 None] Transfer volume completed successfully. Aug 26 19:04:15 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_hd4l276m Aug 26 19:04:15 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:16 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_hd4l276m" returned: 0 in 0.413s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_hd4l276m {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:16 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 1073741824" returned: 0 in 0.558s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:16 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 Aug 26 19:04:16 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:16 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_hd4l276m Aug 26 19:04:16 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Acquiring lock "cinder-fa2effe9-007e-4685-a964-d456ca73106b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Lock "cinder-fa2effe9-007e-4685-a964-d456ca73106b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Acquiring lock "cinder-quobyte-fa2effe9-007e-4685-a964-d456ca73106b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Lock "cinder-quobyte-fa2effe9-007e-4685-a964-d456ca73106b" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c48da5-09a0-4edc-a507-ca7c1270a17b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:16 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_hd4l276m" returned: 1 in 0.398s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_hd4l276m' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42fdf0f-1f13-432b-bf33-c26fdcf27433]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:16 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4" returned: 0 in 0.335s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b536fb-3bfa-40ef-81a6-344dc9139a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eeba1ff-f494-487c-b39f-1f97453a74f4', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0756cc8-4607-4e2b-b113-925d0a67bebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:16 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Volume volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 (2eeba1ff-f494-487c-b39f-1f97453a74f4): created successfully Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0756cc8-4607-4e2b-b113-925d0a67bebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (6b03f979-2a4f-4911-bce6-ffb8ab06b084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:16 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-63cfe71e-63de-457e-b765-61f52ba2139a tempest-VolumesGetTest-1068532465 None] Created volume successfully. Aug 26 19:04:16 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b Aug 26 19:04:16 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:16 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD Aug 26 19:04:16 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:16 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] a20b2d73-0a49-4820-9be0-26e70205cff9 was qcow2, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:16 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b" returned: 0 in 0.420s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:16 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b Aug 26 19:04:16 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:16 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b Aug 26 19:04:16 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:17 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa2effe9-007e-4685-a964-d456ca73106b" returned: 0 in 0.288s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Lock "cinder-quobyte-fa2effe9-007e-4685-a964-d456ca73106b" released by "delete_volume" :: held 0.759s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Created reservations ['59a067c6-1aa5-401e-b1bb-290d135e12f7', '26da5d72-d170-4640-b58d-bf0b6eb2d875', '22af8a2e-bb0a-4f57-9130-fafa975a6d6e', '6ae525f4-ad6a-4582-8074-08ecc4058dc8'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:17 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:17 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-2eeba1ff-f494-487c-b39f-1f97453a74f4-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Lock "cinder-2eeba1ff-f494-487c-b39f-1f97453a74f4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-quobyte-2eeba1ff-f494-487c-b39f-1f97453a74f4" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.549s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:17 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-2eeba1ff-f494-487c-b39f-1f97453a74f4" acquired by "delete_volume" :: waited 0.048s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Deleted volume successfully. Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[532e46f8-eb9e-4bc2-8f69-d0277984bdb1]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-80c8fe4b-e54a-494f-ae25-f99dba839060 tempest-VolumesTransfersV355Test-260680344 None] Lock "cinder-fa2effe9-007e-4685-a964-d456ca73106b-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:18 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 Aug 26 19:04:18 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Flow 'volume_create_manager' (a86c5cc4-d6e6-4730-867b-394a8a40960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0167aa-2a40-4973-871c-03b5748a2695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0167aa-2a40-4973-871c-03b5748a2695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-928967035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af624648-31fc-43db-9990-8067790c19e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e51f93af674f5c98f40705be7255cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:18Z,use_quota=True,user_id='9d89fde072564985aff6bc4738fe9b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed39bc6-192a-4287-8756-4d8b87410aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed39bc6-192a-4287-8756-4d8b87410aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6535c340-9380-4423-b431-34245faa1e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6535c340-9380-4423-b431-34245faa1e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af624648-31fc-43db-9990-8067790c19e2', 'volume_name': 'volume-af624648-31fc-43db-9990-8067790c19e2', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:18 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cea47c-24e3-4247-ba46-2e8694fc90e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cea47c-24e3-4247-ba46-2e8694fc90e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33269c69-e4f8-467e-af1c-8063038857f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:18 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Volume af624648-31fc-43db-9990-8067790c19e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af624648-31fc-43db-9990-8067790c19e2', 'volume_size': 1} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-928967035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af624648-31fc-43db-9990-8067790c19e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e51f93af674f5c98f40705be7255cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:18Z,use_quota=True,user_id='9d89fde072564985aff6bc4738fe9b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Creating volume af624648-31fc-43db-9990-8067790c19e2 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:18 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4" returned: 0 in 0.639s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:18 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2 1073741824 Aug 26 19:04:18 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:18 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4 Aug 26 19:04:18 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:18 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-2eeba1ff-f494-487c-b39f-1f97453a74f4" returned: 0 in 0.378s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-2eeba1ff-f494-487c-b39f-1f97453a74f4" released by "delete_volume" :: held 1.090s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Created reservations ['fa833c3f-5577-4817-a964-bf8d1a0ea178', '9d098f6a-b64a-41e2-8236-a0535a18818e', '19a65a26-befc-46c1-9e9b-9a2acbd533b6', '7307d8a0-5c27-4049-bef1-ad3063ec2a3d'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:19 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:19 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:19 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2 1073741824" returned: 0 in 0.686s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:19 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2 Aug 26 19:04:19 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:19 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b" returned: 0 in 2.578s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_p0unpgr3devstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:04:19 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Converted 112.00 MB image at 43.43 MB/s Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:19 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b 1G Aug 26 19:04:19 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:19 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.318s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Deleted volume successfully. Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e1aaf5d0-dbe2-445e-871e-7c293ddd1f6b tempest-VolumesGetTest-1068532465 None] Lock "cinder-2eeba1ff-f494-487c-b39f-1f97453a74f4-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:19 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2" returned: 0 in 0.296s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33269c69-e4f8-467e-af1c-8063038857f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af624648-31fc-43db-9990-8067790c19e2', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385bec11-5c31-4f8c-b91e-d907f093ccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:19 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Volume volume-af624648-31fc-43db-9990-8067790c19e2 (af624648-31fc-43db-9990-8067790c19e2): created successfully Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385bec11-5c31-4f8c-b91e-d907f093ccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Flow 'volume_create_manager' (a86c5cc4-d6e6-4730-867b-394a8a40960a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b45a2921-cfad-45f7-a1ff-f33f01c7093b tempest-VolumesTransfersV355Test-1537075033 None] Created volume successfully. Aug 26 19:04:19 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b 1G" returned: 0 in 0.357s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Downloaded image a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume 61592d7e-85c4-42bf-8141-576667172f1b successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 for user 8e96159d4f8a4e198521ba2f5b50fd6e is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Marking volume 61592d7e-85c4-42bf-8141-576667172f1b as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Copying metadata from image a20b2d73-0a49-4820-9be0-26e70205cff9 to 61592d7e-85c4-42bf-8141-576667172f1b. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Creating volume glance metadata for volume 61592d7e-85c4-42bf-8141-576667172f1b backed by image a20b2d73-0a49-4820-9be0-26e70205cff9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29811230-f442-4a6d-a7b8-54dd2138b8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61592d7e-85c4-42bf-8141-576667172f1b', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ed6df9-ee98-4084-859f-aaddbc9aff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:19 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Volume volume-61592d7e-85c4-42bf-8141-576667172f1b (61592d7e-85c4-42bf-8141-576667172f1b): created successfully Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ed6df9-ee98-4084-859f-aaddbc9aff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Flow 'volume_create_manager' (43714b8e-67a3-485c-b9dd-f1e95794fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-45b1290c-7e4c-49ee-b09d-9129604f09f8 tempest-VolumesExtendTest-1291832889 None] Created volume successfully. Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-f01c416e-a674-4af4-8b62-3ab8cd88b2a5-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Lock "cinder-f01c416e-a674-4af4-8b62-3ab8cd88b2a5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-quobyte-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32bbe69-8805-4502-866d-a866ee868a93]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-20591885-2c9d-40aa-8a9f-571a1411b514 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-20591885-2c9d-40aa-8a9f-571a1411b514 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:20 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 Aug 26 19:04:20 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c23900b-aa3c-4cdd-a0cb-590c41e5428e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-20591885-2c9d-40aa-8a9f-571a1411b514 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:20 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b Aug 26 19:04:20 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:20 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" returned: 0 in 0.414s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:20 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5 Aug 26 19:04:20 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:20 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-20591885-2c9d-40aa-8a9f-571a1411b514 tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b" returned: 0 in 0.426s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-20591885-2c9d-40aa-8a9f-571a1411b514 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b 2G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Acquiring lock "cinder-af624648-31fc-43db-9990-8067790c19e2-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Lock "cinder-af624648-31fc-43db-9990-8067790c19e2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Acquiring lock "cinder-quobyte-af624648-31fc-43db-9990-8067790c19e2" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-20591885-2c9d-40aa-8a9f-571a1411b514 tempest-VolumesExtendTest-1291832889 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b 2G" returned: 0 in 0.144s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-20591885-2c9d-40aa-8a9f-571a1411b514 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.610s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:20 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" returned: 0 in 0.310s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Lock "cinder-quobyte-af624648-31fc-43db-9990-8067790c19e2" acquired by "delete_volume" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-f01c416e-a674-4af4-8b62-3ab8cd88b2a5" released by "delete_volume" :: held 0.780s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fd5242-ad32-486f-bea5-582c0ad201b3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:20 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-20591885-2c9d-40aa-8a9f-571a1411b514 tempest-VolumesExtendTest-1291832889 None] Extend volume completed successfully. Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Created reservations ['96a4548a-d74d-41a8-94f9-6ae980e66cd6', '8d05525f-62b5-41d1-94b2-bfc681c253b8', '13fde861-360e-4cb0-baa6-23225ce6296a', 'cd85d948-74c3-4646-b78a-793b6ea75914'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:21 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2 Aug 26 19:04:21 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:21 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:21 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:21 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.263s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-d0902b98-758c-404e-9ea5-97106245237e-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Deleted volume successfully. Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Lock "cinder-d0902b98-758c-404e-9ea5-97106245237e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5a813c37-af7f-4ae3-9e70-66430a089972 tempest-VolumesGetTest-1068532465 None] Lock "cinder-f01c416e-a674-4af4-8b62-3ab8cd88b2a5-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:21 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2" returned: 0 in 0.470s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:21 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2 Aug 26 19:04:21 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-quobyte-d0902b98-758c-404e-9ea5-97106245237e" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-d0902b98-758c-404e-9ea5-97106245237e" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d92be91-2dc5-41fd-80b2-92e13b08aa4f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "cinder-61592d7e-85c4-42bf-8141-576667172f1b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:21 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Lock "cinder-61592d7e-85c4-42bf-8141-576667172f1b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:21 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "cinder-quobyte-61592d7e-85c4-42bf-8141-576667172f1b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:21 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-af624648-31fc-43db-9990-8067790c19e2" returned: 0 in 0.311s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Lock "cinder-quobyte-61592d7e-85c4-42bf-8141-576667172f1b" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Lock "cinder-quobyte-af624648-31fc-43db-9990-8067790c19e2" released by "delete_volume" :: held 0.843s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd05881f-29f9-4842-bf76-434d5edde6dc]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Created reservations ['a6beb137-dfc7-4414-8586-0619203ecb61', '8e4adcdd-6d2f-4c20-b07b-b743169159d9', 'd51d7d38-7837-4e89-b908-40d253d3592f', '442d1316-0498-4253-a630-de2fad0a9e1e'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:21 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b Aug 26 19:04:21 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:21 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:21 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:21 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e" returned: 0 in 0.474s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:22 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e Aug 26 19:04:22 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:22 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.298s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:22 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b" returned: 0 in 0.475s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Deleted volume successfully. Aug 26 19:04:22 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b Aug 26 19:04:22 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:22 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4c2f19a3-d5ed-499f-872c-cdedfac6d91e tempest-VolumesTransfersV355Test-260680344 None] Lock "cinder-af624648-31fc-43db-9990-8067790c19e2-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d0902b98-758c-404e-9ea5-97106245237e" returned: 0 in 0.307s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-d0902b98-758c-404e-9ea5-97106245237e" released by "delete_volume" :: held 0.843s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Created reservations ['53a8ff53-a8e6-4271-a7e6-7ae2fea16864', '908a80b5-f34b-44b4-8cbd-ff5c4ea60145', 'ea2a18fb-ed40-4201-a10b-57fca8d0cbf5', '980c9e27-e320-498b-9350-90e839b8c6bc'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:22 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:22 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:22 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-61592d7e-85c4-42bf-8141-576667172f1b" returned: 0 in 0.312s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Lock "cinder-quobyte-61592d7e-85c4-42bf-8141-576667172f1b" released by "delete_volume" :: held 0.838s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Created reservations ['257d6038-5db4-4391-87da-905649aef92f', 'c84cc184-f7e7-46b2-a77f-7aa034cffdf7', '7303c9c3-8553-4910-baae-0bb4e11e94b4', 'cd5c6a74-5632-455e-9280-ecc4fecc2555'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:22 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:22 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:22 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.377s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Deleted volume successfully. Aug 26 19:04:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-4aaafc4d-6de0-4e70-bc5f-857ad18eacbd tempest-VolumesGetTest-1068532465 None] Lock "cinder-d0902b98-758c-404e-9ea5-97106245237e-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:23 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.331s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:23 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Deleted volume successfully. Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-16d81443-5c42-40e8-ad06-ff7dbc60b1f7 tempest-VolumesExtendTest-1291832889 None] Lock "cinder-61592d7e-85c4-42bf-8141-576667172f1b-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Flow 'volume_create_manager' (434528c0-e05b-4bce-8a6a-9f07c1c8622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdce8f47-d3fa-46bd-ac71-621bd1be43c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdce8f47-d3fa-46bd-ac71-621bd1be43c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-989968033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3e1781-1206-4230-924f-8a91a7052e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ecbf96f75848f0b33521cd89c43963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:24Z,use_quota=True,user_id='8e96159d4f8a4e198521ba2f5b50fd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbe0299-00ce-4217-ad75-637d1d32b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbe0299-00ce-4217-ad75-637d1d32b495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6375febb-1085-414d-a388-737fd6c58b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6375febb-1085-414d-a388-737fd6c58b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3e1781-1206-4230-924f-8a91a7052e67', 'volume_name': 'volume-9a3e1781-1206-4230-924f-8a91a7052e67', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcacecb9-655a-48b4-aaae-7e2ec0949130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcacecb9-655a-48b4-aaae-7e2ec0949130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32a3d10-a3b2-4c8c-a65f-499713e48f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:23 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Volume 9a3e1781-1206-4230-924f-8a91a7052e67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3e1781-1206-4230-924f-8a91a7052e67', 'volume_size': 1} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-989968033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3e1781-1206-4230-924f-8a91a7052e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ecbf96f75848f0b33521cd89c43963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:24Z,use_quota=True,user_id='8e96159d4f8a4e198521ba2f5b50fd6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Creating volume 9a3e1781-1206-4230-924f-8a91a7052e67 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:23 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:23 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 1073741824 Aug 26 19:04:23 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (99b6d00e-bf7b-499f-91d3-5bb52201af79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4c405f-61db-486e-bce7-ee9cb83c69c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4c405f-61db-486e-bce7-ee9cb83c69c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1223591014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d75c364-34cf-4a9f-bc18-cf05dd9cf793,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:24Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c38358-d0f5-4f4d-8e13-8ee9b139d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c38358-d0f5-4f4d-8e13-8ee9b139d08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc94884-c923-4864-aa17-5f6915993fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:23 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc94884-c923-4864-aa17-5f6915993fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d75c364-34cf-4a9f-bc18-cf05dd9cf793', 'volume_name': 'volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2ce875-ad54-4040-9ca1-6b31021c0ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2ce875-ad54-4040-9ca1-6b31021c0ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:24 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6feccdc-00ef-454f-a27f-ded3f77c806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:24 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Volume 6d75c364-34cf-4a9f-bc18-cf05dd9cf793: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Trying to clone 6d75c364-34cf-4a9f-bc18-cf05dd9cf793 from image a20b2d73-0a49-4820-9be0-26e70205cff9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 1073741824" returned: 0 in 0.534s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:24 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 Aug 26 19:04:24 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 19:04:24 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Image download 20.69 MB at 20.69 MB/s Aug 26 19:04:24 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67" returned: 0 in 0.321s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32a3d10-a3b2-4c8c-a65f-499713e48f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3e1781-1206-4230-924f-8a91a7052e67', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fd659a-20de-46d0-9355-fa7e301d2938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:24 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Volume volume-9a3e1781-1206-4230-924f-8a91a7052e67 (9a3e1781-1206-4230-924f-8a91a7052e67): created successfully Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fd659a-20de-46d0-9355-fa7e301d2938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Flow 'volume_create_manager' (434528c0-e05b-4bce-8a6a-9f07c1c8622f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1382bbe0-ca7f-475d-bee5-294fec136ab6]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:24 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-443bd1ea-6338-48ec-ba5f-bb6a696ba757 tempest-VolumesExtendTest-1291832889 None] Created volume successfully. Aug 26 19:04:24 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD Aug 26 19:04:24 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:25 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 is fetched for user 22c92903ed2e4a8faf89bdbf20c942c2. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad0513e-a4ec-4cc8-a9ad-96f938c9dd76]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:25 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD Aug 26 19:04:25 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:25 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1223591014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d75c364-34cf-4a9f-bc18-cf05dd9cf793,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:24Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Creating volume 6d75c364-34cf-4a9f-bc18-cf05dd9cf793 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:25 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:25 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 1073741824 Aug 26 19:04:25 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:26 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 1073741824" returned: 0 in 0.523s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:26 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 Aug 26 19:04:26 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:26 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793" returned: 0 in 0.297s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.658s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Creating offline snapshot f53606b3-4bcd-411e-9d08-717eb957e51b of volume 9a3e1781-1206-4230-924f-8a91a7052e67 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Attempting download of a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume 6d75c364-34cf-4a9f-bc18-cf05dd9cf793. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0781691d-b6da-45d9-9ee2-1a654833435c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4c8948-26b1-4b86-93d7-da38d1839cfc]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_mzt6v7ei {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:26 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 Aug 26 19:04:26 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:26 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_mzt6v7ei Aug 26 19:04:26 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:26 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67" returned: 0 in 0.454s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:26 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_mzt6v7ei" returned: 0 in 0.403s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_mzt6v7ei {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:26 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b 1G Aug 26 19:04:27 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:27 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_mzt6v7ei Aug 26 19:04:27 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:27 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_mzt6v7ei" returned: 1 in 0.383s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a20b2d73-0a49-4820-9be0-26e70205cff9_mzt6v7ei' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[648b5a02-efc3-4bd7-9e78-4e693b821fd8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:27 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b 1G" returned: 0 in 0.475s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3e1781-1206-4230-924f-8a91a7052e67 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:27 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3e1781-1206-4230-924f-8a91a7052e67 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b Aug 26 19:04:27 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:27 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD Aug 26 19:04:27 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:27 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] a20b2d73-0a49-4820-9be0-26e70205cff9 was qcow2, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:27 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 Aug 26 19:04:27 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:27 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3e1781-1206-4230-924f-8a91a7052e67 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b" returned: 0 in 0.359s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:27 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b is being set with open permissions: ugo+rw Aug 26 19:04:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:27 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b Aug 26 19:04:27 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:28 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b" returned: 0 in 0.292s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:28 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.info Aug 26 19:04:28 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:28 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.info" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:28 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.info is being set with open permissions: ugo+rw Aug 26 19:04:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:28 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.info Aug 26 19:04:28 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:28 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.info" returned: 0 in 0.308s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7e684f33-e0d4-4d97-a4b4-b29d5588905e tempest-VolumesExtendTest-1291832889 None] Create snapshot completed successfully Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3ac4025a-c504-43bc-b4b5-00823bfc5d49 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3ac4025a-c504-43bc-b4b5-00823bfc5d49 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3be98a-6e2e-4a17-8d73-3a8f51fb305f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3ac4025a-c504-43bc-b4b5-00823bfc5d49 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:29 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 Aug 26 19:04:29 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:29 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3ac4025a-c504-43bc-b4b5-00823bfc5d49 tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67" returned: 0 in 0.462s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3ac4025a-c504-43bc-b4b5-00823bfc5d49 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b 2G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3ac4025a-c504-43bc-b4b5-00823bfc5d49 tempest-VolumesExtendTest-1291832889 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b 2G" returned: 0 in 0.187s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:29 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3ac4025a-c504-43bc-b4b5-00823bfc5d49 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.691s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793" returned: 0 in 2.081s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a20b2d73-0a49-4820-9be0-26e70205cff9_9wicfa3qdevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:04:29 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Converted 112.00 MB image at 53.79 MB/s Aug 26 19:04:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:29 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 1G Aug 26 19:04:29 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3ac4025a-c504-43bc-b4b5-00823bfc5d49 tempest-VolumesExtendTest-1291832889 None] Extend volume completed successfully. Aug 26 19:04:30 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 1G" returned: 0 in 0.379s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Downloaded image a20b2d73-0a49-4820-9be0-26e70205cff9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}])) to volume 6d75c364-34cf-4a9f-bc18-cf05dd9cf793 successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Temporary image a20b2d73-0a49-4820-9be0-26e70205cff9 for user 22c92903ed2e4a8faf89bdbf20c942c2 is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Marking volume 6d75c364-34cf-4a9f-bc18-cf05dd9cf793 as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Copying metadata from image a20b2d73-0a49-4820-9be0-26e70205cff9 to 6d75c364-34cf-4a9f-bc18-cf05dd9cf793. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Creating volume glance metadata for volume 6d75c364-34cf-4a9f-bc18-cf05dd9cf793 backed by image a20b2d73-0a49-4820-9be0-26e70205cff9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6feccdc-00ef-454f-a27f-ded3f77c806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793', 'volume_size': 1, 'image_id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a20b2d73-0a49-4820-9be0-26e70205cff9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92f8c2050d3d4da39fd1d7cab14f5fa1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a20b2d73-0a49-4820-9be0-26e70205cff9', 'created_at': datetime.datetime(2026, 8, 26, 16, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a20b2d73-0a49-4820-9be0-26e70205cff9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26069aa9-e8ce-4090-80aa-fb45e8489ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:30 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Volume volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 (6d75c364-34cf-4a9f-bc18-cf05dd9cf793): created successfully Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26069aa9-e8ce-4090-80aa-fb45e8489ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (99b6d00e-bf7b-499f-91d3-5bb52201af79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7d0059e8-26f6-4344-9b71-844e53ba02aa tempest-VolumesGetTest-1068532465 None] Created volume successfully. Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Acquiring lock "cinder-f53606b3-4bcd-411e-9d08-717eb957e51b-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Lock "cinder-f53606b3-4bcd-411e-9d08-717eb957e51b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Acquiring lock "cinder-quobyte-9a3e1781-1206-4230-924f-8a91a7052e67" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Flow 'volume_create_manager' (c0f68ce8-a1b3-4567-b590-49b7cc300182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9672a5-54d9-4aaf-9da5-212c8a541a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Lock "cinder-quobyte-9a3e1781-1206-4230-924f-8a91a7052e67" acquired by "delete_snapshot" :: waited 0.066s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Acquiring lock "cinder-quobyte-f53606b3-4bcd-411e-9d08-717eb957e51b" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9672a5-54d9-4aaf-9da5-212c8a541a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1967356767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c897d470-893f-4625-b1e1-b5a9af8e423d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31bc8b4c9e14d5b88d985f62b28e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:30Z,use_quota=True,user_id='1f82ae9929fe4bbbb6e7e3e0a70c5049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7078d01a-74ba-4a9d-9441-d8392f9bb4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7078d01a-74ba-4a9d-9441-d8392f9bb4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d134b5-6388-48e6-b7ba-525550f78151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d134b5-6388-48e6-b7ba-525550f78151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c897d470-893f-4625-b1e1-b5a9af8e423d', 'volume_name': 'volume-c897d470-893f-4625-b1e1-b5a9af8e423d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfaef3d-e8bb-4e24-bc23-b1bb475ac5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfaef3d-e8bb-4e24-bc23-b1bb475ac5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ffc5da-e82c-43f9-85f3-05a6b259ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:30 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Volume c897d470-893f-4625-b1e1-b5a9af8e423d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c897d470-893f-4625-b1e1-b5a9af8e423d', 'volume_size': 1} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1967356767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c897d470-893f-4625-b1e1-b5a9af8e423d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31bc8b4c9e14d5b88d985f62b28e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:30Z,use_quota=True,user_id='1f82ae9929fe4bbbb6e7e3e0a70c5049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Creating volume c897d470-893f-4625-b1e1-b5a9af8e423d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:30 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Lock "cinder-quobyte-f53606b3-4bcd-411e-9d08-717eb957e51b" acquired by "_delete_snapshot" :: waited 0.101s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Deleting offline snapshot f53606b3-4bcd-411e-9d08-717eb957e51b of volume 9a3e1781-1206-4230-924f-8a91a7052e67 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:04:30 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d 1073741824 Aug 26 19:04:30 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] snapshot_file for this snap is: volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a13c2aa-20f8-46ab-bc27-feb71fe23ee7]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:30 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b Aug 26 19:04:30 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:31 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d 1073741824" returned: 0 in 0.527s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:31 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b" returned: 0 in 0.484s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a3e1781-1206-4230-924f-8a91a7052e67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1495f288-5513-4816-b55e-093385c4a247]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:31 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d Aug 26 19:04:31 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:31 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 Aug 26 19:04:31 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:31 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d" returned: 0 in 0.361s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ffc5da-e82c-43f9-85f3-05a6b259ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c897d470-893f-4625-b1e1-b5a9af8e423d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7da77b-25b5-4bf8-b4f2-6e1e3e52d53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Volume volume-c897d470-893f-4625-b1e1-b5a9af8e423d (c897d470-893f-4625-b1e1-b5a9af8e423d): created successfully Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7da77b-25b5-4bf8-b4f2-6e1e3e52d53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Flow 'volume_create_manager' (c0f68ce8-a1b3-4567-b590-49b7cc300182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-cbe1b6b5-6b14-4156-a92e-8d35739abadb tempest-VolumesTransfersV357Test-249230393 None] Created volume successfully. Aug 26 19:04:31 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67" returned: 0 in 0.589s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:31 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b Aug 26 19:04:31 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (7299dd96-256f-4831-83b7-88bcefa6fc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7800b665-6fbc-4132-96b5-f12167b5a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7800b665-6fbc-4132-96b5-f12167b5a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-314138643',display_name='tempest-VolumesGetTest-Volume-150455461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cf9592-e8de-436e-b456-7a841318ec75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:32Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07de4e5-5468-4114-a2e0-2406e9c00293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07de4e5-5468-4114-a2e0-2406e9c00293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa9c52c-9d3c-4b1c-a96c-8b1e9f8e962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa9c52c-9d3c-4b1c-a96c-8b1e9f8e962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22cf9592-e8de-436e-b456-7a841318ec75', 'volume_name': 'volume-22cf9592-e8de-436e-b456-7a841318ec75', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609dbd8d-4df5-46e9-b8c6-da239f07ce21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609dbd8d-4df5-46e9-b8c6-da239f07ce21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6143d3-f805-4f7e-bbcc-d6be4c48d6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:32 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Volume 22cf9592-e8de-436e-b456-7a841318ec75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22cf9592-e8de-436e-b456-7a841318ec75', 'volume_size': 1} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-314138643',display_name='tempest-VolumesGetTest-Volume-150455461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cf9592-e8de-436e-b456-7a841318ec75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b8575e4540449ebd295d118318ffb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:32Z,use_quota=True,user_id='22c92903ed2e4a8faf89bdbf20c942c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Creating volume 22cf9592-e8de-436e-b456-7a841318ec75 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:32 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:32 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75 1073741824 Aug 26 19:04:32 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:32 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b" returned: 0 in 0.566s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:32 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b Aug 26 19:04:32 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:32 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67.f53606b3-4bcd-411e-9d08-717eb957e51b" returned: 0 in 0.479s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Lock "cinder-quobyte-f53606b3-4bcd-411e-9d08-717eb957e51b" released by "_delete_snapshot" :: held 2.290s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Lock "cinder-quobyte-9a3e1781-1206-4230-924f-8a91a7052e67" released by "delete_snapshot" :: held 2.406s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:33 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Created reservations ['e3cf541c-ccc9-4144-9d59-87103ef61aca', 'a3bb843c-7a2f-4841-b4db-8079cd8e6ea8', '577dc4f3-e7c4-4f55-93ab-d43b52786a7e', '8fe60836-1972-4b10-9c86-fadacfe07a14'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75 1073741824" returned: 0 in 0.768s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Delete snapshot completed successfully. Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a67a128-4dd4-483c-b55c-d596417eb91c tempest-VolumesExtendTest-1291832889 None] Lock "cinder-f53606b3-4bcd-411e-9d08-717eb957e51b-delete_snapshot" released by "delete_snapshot" :: held 2.724s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:33 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75 Aug 26 19:04:33 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:33 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75" returned: 0 in 0.348s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a119ef43-13eb-4084-b060-a3b08e356cb4 tempest-VolumesTransfersV357Test-1316516196 None] Transfer volume completed successfully. Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6143d3-f805-4f7e-bbcc-d6be4c48d6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22cf9592-e8de-436e-b456-7a841318ec75', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfadf3c9-1aed-4970-a20d-3ee43959a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Volume volume-22cf9592-e8de-436e-b456-7a841318ec75 (22cf9592-e8de-436e-b456-7a841318ec75): created successfully Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfadf3c9-1aed-4970-a20d-3ee43959a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Flow 'volume_create_manager' (7299dd96-256f-4831-83b7-88bcefa6fc05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-1776d0e6-2fa7-429f-8159-4be4fd8706bf tempest-VolumesGetTest-1068532465 None] Created volume successfully. Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "cinder-9a3e1781-1206-4230-924f-8a91a7052e67-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Lock "cinder-9a3e1781-1206-4230-924f-8a91a7052e67-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "cinder-quobyte-9a3e1781-1206-4230-924f-8a91a7052e67" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Lock "cinder-quobyte-9a3e1781-1206-4230-924f-8a91a7052e67" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71dd222-3378-4d9c-ba3d-f817f82fbeb2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:34 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 Aug 26 19:04:34 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Acquiring lock "cinder-c897d470-893f-4625-b1e1-b5a9af8e423d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Lock "cinder-c897d470-893f-4625-b1e1-b5a9af8e423d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-3b9c2040-413e-43df-b0e1-1f6234d8693f tempest-TestShelveInstance-2107740106 None] Terminate volume connection completed successfully. Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-3b9c2040-413e-43df-b0e1-1f6234d8693f tempest-TestShelveInstance-2107740106 None] Deleting attachment ca221267-b8bd-46b2-97e4-5f5641bbe593. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Acquiring lock "cinder-quobyte-c897d470-893f-4625-b1e1-b5a9af8e423d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Lock "cinder-quobyte-c897d470-893f-4625-b1e1-b5a9af8e423d" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c73f8c2-8207-4fea-b967-d72a0e2c3120]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:34 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67" returned: 0 in 0.624s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-22cf9592-e8de-436e-b456-7a841318ec75-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Lock "cinder-22cf9592-e8de-436e-b456-7a841318ec75-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:34 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67 Aug 26 19:04:34 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Acquiring lock "cinder-42a8024f-4ac6-405b-adbc-e519c9a4331d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-quobyte-22cf9592-e8de-436e-b456-7a841318ec75" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Lock "cinder-42a8024f-4ac6-405b-adbc-e519c9a4331d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:34 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-22cf9592-e8de-436e-b456-7a841318ec75" acquired by "delete_volume" :: waited 0.046s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:34 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[983ee77d-e58c-4be0-bcb3-3e912e961190]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Acquiring lock "cinder-quobyte-42a8024f-4ac6-405b-adbc-e519c9a4331d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Lock "cinder-quobyte-42a8024f-4ac6-405b-adbc-e519c9a4331d" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce251d7-83b7-4275-8b6f-c6535b479def]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:35 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a3e1781-1206-4230-924f-8a91a7052e67" returned: 0 in 0.443s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:35 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75 Aug 26 19:04:35 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Lock "cinder-quobyte-9a3e1781-1206-4230-924f-8a91a7052e67" released by "delete_volume" :: held 1.170s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:35 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d Aug 26 19:04:35 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Created reservations ['7120b576-d5c6-4bc6-b2a5-c38f91ea47d8', '4e089115-5df9-4ed0-aef7-a14b8675e883', '5fcf7be9-8e0d-4bac-802c-74cee03b2908', '99252516-eb42-4291-a839-860a9d6feef9'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:35 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d" returned: 0 in 0.660s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:35 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d Aug 26 19:04:35 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:35 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:35 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:35 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75" returned: 0 in 0.647s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:35 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75 Aug 26 19:04:35 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:35 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d" returned: 0 in 0.575s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:35 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d Aug 26 19:04:35 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:35 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c897d470-893f-4625-b1e1-b5a9af8e423d" returned: 0 in 0.425s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Lock "cinder-quobyte-c897d470-893f-4625-b1e1-b5a9af8e423d" released by "delete_volume" :: held 1.145s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Created reservations ['100d395e-267f-49e7-8ec8-dc9371f22549', '448c1015-4bad-4601-a6ba-c187e44b458f', '5849b3f8-768f-4f2f-a691-d7c68e498c4d', 'e1c0c72d-bec5-4f0e-899b-934548fe241b'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:35 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Deleted volume successfully. Aug 26 19:04:35 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-22cf9592-e8de-436e-b456-7a841318ec75" returned: 0 in 0.361s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:35 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-22cf9592-e8de-436e-b456-7a841318ec75" released by "delete_volume" :: held 1.094s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-88116ef3-7dd2-4831-a01e-08a3942e3a47 tempest-VolumesExtendTest-1291832889 None] Lock "cinder-9a3e1781-1206-4230-924f-8a91a7052e67-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-42a8024f-4ac6-405b-adbc-e519c9a4331d" returned: 0 in 0.328s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Lock "cinder-quobyte-42a8024f-4ac6-405b-adbc-e519c9a4331d" released by "delete_volume" :: held 0.961s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:35 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:35 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Created reservations ['3d6e4d14-8b2a-4f8a-9126-b1d5eab36892', '8d037141-612a-44ca-8e13-eb6ee03536f3', '3712537d-9de9-4c39-b453-228ca0ddb849', '8a440646-abb5-4d05-97d7-0917dc60c86b'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:35 devstack cinder-volume[93671]: DEBUG cinder.quota [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Created reservations ['c3e8b73b-cf18-4527-a497-2afb6c4f53ce', '1b1f7766-c486-47cf-b66c-49b18578a3d8', '994dd61d-ce8d-4658-9c42-df9654c8d9f4', 'ba2faf35-474b-4a9a-9a6e-6eeb1e4b54fa'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:36 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:36 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:36 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:36 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:36 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.313s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:36 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Deleted volume successfully. Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9fb1bbfa-ec63-4efa-bf7a-108893a7b3a9 tempest-VolumesTransfersV357Test-656560858 None] Lock "cinder-c897d470-893f-4625-b1e1-b5a9af8e423d-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:36 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.315s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:36 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Deleted volume successfully. Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-da256984-b364-4941-ad6b-53400cb35a3c tempest-VolumesGetTest-1068532465 None] Lock "cinder-22cf9592-e8de-436e-b456-7a841318ec75-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:36 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.337s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.manager [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:36 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Deleted volume successfully. Aug 26 19:04:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [req-c18d0b88-be8e-4651-b3a0-61b3e8bc078d req-dae92960-291d-4099-b580-4586fe90f857 tempest-TestShelveInstance-2107740106 None] Lock "cinder-42a8024f-4ac6-405b-adbc-e519c9a4331d-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-6d75c364-34cf-4a9f-bc18-cf05dd9cf793-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Lock "cinder-6d75c364-34cf-4a9f-bc18-cf05dd9cf793-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Acquiring lock "cinder-quobyte-6d75c364-34cf-4a9f-bc18-cf05dd9cf793" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-6d75c364-34cf-4a9f-bc18-cf05dd9cf793" acquired by "delete_volume" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa7e06c-21ff-4c8c-adf4-11c2b7f58b8c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:37 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 Aug 26 19:04:37 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Flow 'volume_create_manager' (cde20c9c-b9c0-4491-adf3-58ed27d6335f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c60666e-9e52-40e6-b119-a58dc39dbcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c60666e-9e52-40e6-b119-a58dc39dbcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1726564526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57ecc94-4bd5-4c56-9d53-974342f39d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31bc8b4c9e14d5b88d985f62b28e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:37Z,use_quota=True,user_id='1f82ae9929fe4bbbb6e7e3e0a70c5049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ba3376-a50e-4050-9c11-6f16aaa2d745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ba3376-a50e-4050-9c11-6f16aaa2d745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57eccdf5-82c0-4084-9d8c-28a55f646ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57eccdf5-82c0-4084-9d8c-28a55f646ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a57ecc94-4bd5-4c56-9d53-974342f39d57', 'volume_name': 'volume-a57ecc94-4bd5-4c56-9d53-974342f39d57', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9e3573-1076-41bf-97d5-2bcbf10f148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9e3573-1076-41bf-97d5-2bcbf10f148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbc482b-4f65-4dd7-94be-0a1a12796b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:37 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Volume a57ecc94-4bd5-4c56-9d53-974342f39d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a57ecc94-4bd5-4c56-9d53-974342f39d57', 'volume_size': 1} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1726564526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57ecc94-4bd5-4c56-9d53-974342f39d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31bc8b4c9e14d5b88d985f62b28e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:37Z,use_quota=True,user_id='1f82ae9929fe4bbbb6e7e3e0a70c5049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Creating volume a57ecc94-4bd5-4c56-9d53-974342f39d57 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:37 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:37 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 1073741824 Aug 26 19:04:37 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:37 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793" returned: 0 in 0.588s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:37 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793 Aug 26 19:04:37 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:38 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6d75c364-34cf-4a9f-bc18-cf05dd9cf793" returned: 0 in 0.358s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Lock "cinder-quobyte-6d75c364-34cf-4a9f-bc18-cf05dd9cf793" released by "delete_volume" :: held 1.032s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:38 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 1073741824" returned: 0 in 0.687s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Created reservations ['3e1ecdea-9d3f-4a44-86b4-6642fc434000', '7300168e-e4f9-40ef-af22-f4afe027846c', '7cb33749-ad38-4b7d-a1ec-c6c560833a70', '9cd16451-f7b7-408e-9566-b8962ba6c495'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:38 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 Aug 26 19:04:38 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:38 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:38 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:38 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57" returned: 0 in 0.293s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbc482b-4f65-4dd7-94be-0a1a12796b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57ecc94-4bd5-4c56-9d53-974342f39d57', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7a889d-f413-4d53-8b73-a259011cdf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:38 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Volume volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 (a57ecc94-4bd5-4c56-9d53-974342f39d57): created successfully Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7a889d-f413-4d53-8b73-a259011cdf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Flow 'volume_create_manager' (cde20c9c-b9c0-4491-adf3-58ed27d6335f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c2e4aee0-2817-4215-ba35-705ffbc8534b tempest-VolumesTransfersV357Test-249230393 None] Created volume successfully. Aug 26 19:04:38 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.336s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Deleted volume successfully. Aug 26 19:04:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-43ec9003-39e2-46cf-9beb-fffdfedb8147 tempest-VolumesGetTest-1068532465 None] Lock "cinder-6d75c364-34cf-4a9f-bc18-cf05dd9cf793-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Acquiring lock "cinder-a57ecc94-4bd5-4c56-9d53-974342f39d57-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Lock "cinder-a57ecc94-4bd5-4c56-9d53-974342f39d57-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Acquiring lock "cinder-quobyte-a57ecc94-4bd5-4c56-9d53-974342f39d57" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Lock "cinder-quobyte-a57ecc94-4bd5-4c56-9d53-974342f39d57" acquired by "delete_volume" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b2d104-db88-4f1e-8c11-c0d35cb9e48b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:40 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 Aug 26 19:04:40 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Flow 'volume_create_manager' (7288ae9f-a1a1-407c-bb9b-b65aae4d8d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a50ce1-2fa2-4198-8111-7ad8a2124199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a50ce1-2fa2-4198-8111-7ad8a2124199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-615019169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916657e8-956c-4492-aea6-4eb818bd4c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17eccfae584451399ac40d104ee267d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:40Z,use_quota=True,user_id='9bd2e30c82004c008173f78af15f6514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c042720f-240f-4cc0-9071-45d60668066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c042720f-240f-4cc0-9071-45d60668066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f7c365-f513-4227-9e29-9253bb54aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f7c365-f513-4227-9e29-9253bb54aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916657e8-956c-4492-aea6-4eb818bd4c92', 'volume_name': 'volume-916657e8-956c-4492-aea6-4eb818bd4c92', 'volume_size': 2}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45235386-9e99-4528-aa02-448db1a3fb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45235386-9e99-4528-aa02-448db1a3fb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1848a0e8-a364-4dbd-89a3-a5e20915d2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:40 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Volume 916657e8-956c-4492-aea6-4eb818bd4c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916657e8-956c-4492-aea6-4eb818bd4c92', 'volume_size': 2} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-615019169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916657e8-956c-4492-aea6-4eb818bd4c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17eccfae584451399ac40d104ee267d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:40Z,use_quota=True,user_id='9bd2e30c82004c008173f78af15f6514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Creating volume 916657e8-956c-4492-aea6-4eb818bd4c92 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:40 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 2147483648 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:40 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57" returned: 0 in 0.576s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:40 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 2147483648 Aug 26 19:04:40 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:40 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57 Aug 26 19:04:40 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:41 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a57ecc94-4bd5-4c56-9d53-974342f39d57" returned: 0 in 0.344s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Lock "cinder-quobyte-a57ecc94-4bd5-4c56-9d53-974342f39d57" released by "delete_volume" :: held 0.991s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Created reservations ['2c1dc8da-bcf6-4669-8ab9-d7cebf267452', 'c836eb3d-d4e4-4a08-a88b-90ada8fdedbc', 'b73e291d-366d-449e-8453-71d4b5dcc83a', 'a9a905a8-735c-4693-a8fe-dbb8f02ac94f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:41 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:41 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:41 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 2147483648" returned: 0 in 0.720s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:41 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 Aug 26 19:04:41 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:41 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.326s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Deleted volume successfully. Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-393a9528-e66f-4fd5-96b2-b38fa54353f3 tempest-VolumesTransfersV357Test-656560858 None] Lock "cinder-a57ecc94-4bd5-4c56-9d53-974342f39d57-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:41 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92" returned: 0 in 0.287s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1848a0e8-a364-4dbd-89a3-a5e20915d2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916657e8-956c-4492-aea6-4eb818bd4c92', 'volume_size': 2}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ebbbb7-f5a4-468c-87c8-16595f54bf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:41 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Volume volume-916657e8-956c-4492-aea6-4eb818bd4c92 (916657e8-956c-4492-aea6-4eb818bd4c92): created successfully Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ebbbb7-f5a4-468c-87c8-16595f54bf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Flow 'volume_create_manager' (7288ae9f-a1a1-407c-bb9b-b65aae4d8d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-29514468-bfce-4099-90b3-5c997f9c3b75 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Created volume successfully. Aug 26 19:04:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Creating offline snapshot 15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb of volume 916657e8-956c-4492-aea6-4eb818bd4c92 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:04:42 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[62da1626-de49-42aa-974f-d62c0ce40e79]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:43 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 Aug 26 19:04:43 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:43 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92" returned: 0 in 0.607s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb 2G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:43 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb 2G Aug 26 19:04:43 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Flow 'volume_create_manager' (95f7f720-dace-4033-a031-67c51b3671f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1d9fd5-2573-4347-a0e7-b25a18ace281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1d9fd5-2573-4347-a0e7-b25a18ace281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-51304112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25084947d0241debd0189f6e9886d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:44Z,use_quota=True,user_id='3c7204eeef9343a58ae13c5a62c6d132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d092d070-2f0a-4030-a95a-683d8cb94b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d092d070-2f0a-4030-a95a-683d8cb94b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28d661b-1f22-4ab2-8f9f-344b4f330cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28d661b-1f22-4ab2-8f9f-344b4f330cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8', 'volume_name': 'volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5cbd75-90f5-42df-bdc3-90d836451d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5cbd75-90f5-42df-bdc3-90d836451d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902e2bbb-d8d0-4bf5-84fb-0e218fe84ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:44 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Volume ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8', 'volume_size': 1} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:44 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb 2G" returned: 0 in 0.689s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916657e8-956c-4492-aea6-4eb818bd4c92 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:44 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916657e8-956c-4492-aea6-4eb818bd4c92 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb Aug 26 19:04:44 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:44 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916657e8-956c-4492-aea6-4eb818bd4c92 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb" returned: 0 in 0.355s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:44 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb is being set with open permissions: ugo+rw Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:44 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb Aug 26 19:04:44 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:44 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb" returned: 0 in 0.304s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:45 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.info Aug 26 19:04:45 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:45 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.info" returned: 0 in 0.297s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:45 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.info is being set with open permissions: ugo+rw Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:45 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.info Aug 26 19:04:45 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:45 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.info" returned: 0 in 0.297s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.455s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-51304112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25084947d0241debd0189f6e9886d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:44Z,use_quota=True,user_id='3c7204eeef9343a58ae13c5a62c6d132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Creating volume ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:45 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:45 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 1073741824 Aug 26 19:04:45 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-6c51ff4f-1f32-47ec-84ed-926566c3acd6 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Create snapshot completed successfully Aug 26 19:04:46 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 1073741824" returned: 0 in 0.556s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Acquiring lock "cinder-15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Acquiring lock "cinder-quobyte-916657e8-956c-4492-aea6-4eb818bd4c92" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:46 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 Aug 26 19:04:46 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-quobyte-916657e8-956c-4492-aea6-4eb818bd4c92" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Acquiring lock "cinder-quobyte-15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-quobyte-15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Deleting offline snapshot 15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb of volume 916657e8-956c-4492-aea6-4eb818bd4c92 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] snapshot_file for this snap is: volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec9c94f-72fb-466a-84ea-924afd5e7cbd]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:46 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb Aug 26 19:04:46 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:46 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8" returned: 0 in 0.348s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902e2bbb-d8d0-4bf5-84fb-0e218fe84ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be620abe-af9c-46f3-8d30-965822841792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:46 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Volume volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 (ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8): created successfully Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be620abe-af9c-46f3-8d30-965822841792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Flow 'volume_create_manager' (95f7f720-dace-4033-a031-67c51b3671f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d71b0426-ac75-40e4-ab14-4365c9d425ea tempest-VolumesListTestJSON-978237423 None] Created volume successfully. Aug 26 19:04:46 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb" returned: 0 in 0.457s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-916657e8-956c-4492-aea6-4eb818bd4c92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d1fd13-effc-4c46-8a6e-14cb7cbc01eb]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:47 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 Aug 26 19:04:47 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:47 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92" returned: 0 in 0.462s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:47 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb Aug 26 19:04:47 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:47 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:47 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Flow 'volume_create_manager' (2eed3662-b44f-4b51-b47e-acb00c8a0eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db38ba4-6ced-49d7-8289-ce871bd81e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb" returned: 0 in 0.564s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db38ba4-6ced-49d7-8289-ce871bd81e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1896702518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfba9734-72e2-4f96-a426-581da59f14fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25084947d0241debd0189f6e9886d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:48Z,use_quota=True,user_id='3c7204eeef9343a58ae13c5a62c6d132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:48 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff7fae3-442a-47f8-aca1-d5e8ef9b9947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:48 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff7fae3-442a-47f8-aca1-d5e8ef9b9947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9ab7ec-0428-4371-92ee-ec44b4c25aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9ab7ec-0428-4371-92ee-ec44b4c25aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfba9734-72e2-4f96-a426-581da59f14fc', 'volume_name': 'volume-cfba9734-72e2-4f96-a426-581da59f14fc', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251f41e9-71cb-4de8-8937-9c061e20b431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251f41e9-71cb-4de8-8937-9c061e20b431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa11ad9e-d18f-4a1f-96eb-6a4c55ee059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:48 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Volume cfba9734-72e2-4f96-a426-581da59f14fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfba9734-72e2-4f96-a426-581da59f14fc', 'volume_size': 1} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1896702518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfba9734-72e2-4f96-a426-581da59f14fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25084947d0241debd0189f6e9886d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:48Z,use_quota=True,user_id='3c7204eeef9343a58ae13c5a62c6d132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Creating volume cfba9734-72e2-4f96-a426-581da59f14fc {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:48 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:48 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc 1073741824 Aug 26 19:04:48 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:48 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92.15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb" returned: 0 in 0.414s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-quobyte-15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb" released by "_delete_snapshot" :: held 2.049s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-quobyte-916657e8-956c-4492-aea6-4eb818bd4c92" released by "delete_snapshot" :: held 2.083s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Created reservations ['a14690e4-2eef-483e-bb18-94f7368887ad', 'af413387-6745-4888-bacc-f57e0a1769f9', '7909cf18-75c0-4816-87dc-89d28900f898', 'c8e62d58-8aea-40b5-8cb7-ce753db2b203'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Delete snapshot completed successfully. Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-31e6edf5-b8a9-4709-8168-79c3be096655 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-15051dfd-9878-4fe0-9dd0-2bbdc8c6a0eb-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:48 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc 1073741824" returned: 0 in 0.634s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:48 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc Aug 26 19:04:48 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:49 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc" returned: 0 in 0.287s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa11ad9e-d18f-4a1f-96eb-6a4c55ee059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfba9734-72e2-4f96-a426-581da59f14fc', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fb8f62-ea3a-4980-a4c3-6599db07dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:49 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Volume volume-cfba9734-72e2-4f96-a426-581da59f14fc (cfba9734-72e2-4f96-a426-581da59f14fc): created successfully Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fb8f62-ea3a-4980-a4c3-6599db07dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Flow 'volume_create_manager' (2eed3662-b44f-4b51-b47e-acb00c8a0eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:49 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7f5db98d-bba9-4ad7-95e3-518bfbbbe4e0 tempest-VolumesListTestJSON-978237423 None] Created volume successfully. Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Acquiring lock "cinder-916657e8-956c-4492-aea6-4eb818bd4c92-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-916657e8-956c-4492-aea6-4eb818bd4c92-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Acquiring lock "cinder-quobyte-916657e8-956c-4492-aea6-4eb818bd4c92" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-quobyte-916657e8-956c-4492-aea6-4eb818bd4c92" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[715be033-1187-4b65-9ce8-0450da48698b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:50 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 Aug 26 19:04:50 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:50 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92" returned: 0 in 0.540s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:50 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92 Aug 26 19:04:50 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:50 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-916657e8-956c-4492-aea6-4eb818bd4c92" returned: 0 in 0.401s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-quobyte-916657e8-956c-4492-aea6-4eb818bd4c92" released by "delete_volume" :: held 1.057s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Flow 'volume_create_manager' (b4daffbc-d940-42a7-8f2c-2ed6fbd147a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc8fbdb-dd93-44a8-a92f-7c078c9510b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc8fbdb-dd93-44a8-a92f-7c078c9510b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-546973557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775c7cfc-543c-482f-8d1f-2beef54e04c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25084947d0241debd0189f6e9886d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:51Z,use_quota=True,user_id='3c7204eeef9343a58ae13c5a62c6d132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95bdec1-6990-45d2-8f99-c861efb1a787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95bdec1-6990-45d2-8f99-c861efb1a787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:50 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133d7e6e-73d9-40a3-9bf4-1215e1eda4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133d7e6e-73d9-40a3-9bf4-1215e1eda4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '775c7cfc-543c-482f-8d1f-2beef54e04c3', 'volume_name': 'volume-775c7cfc-543c-482f-8d1f-2beef54e04c3', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fc6c5b-2e70-4025-abce-69d794047a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fc6c5b-2e70-4025-abce-69d794047a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba2fc51-f40d-4c58-a154-beb14e3842b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:51 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Volume 775c7cfc-543c-482f-8d1f-2beef54e04c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-775c7cfc-543c-482f-8d1f-2beef54e04c3', 'volume_size': 1} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-546973557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775c7cfc-543c-482f-8d1f-2beef54e04c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f25084947d0241debd0189f6e9886d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:04:51Z,use_quota=True,user_id='3c7204eeef9343a58ae13c5a62c6d132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Creating volume 775c7cfc-543c-482f-8d1f-2beef54e04c3 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:04:51 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:51 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 1073741824 Aug 26 19:04:51 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Created reservations ['e062de88-4ccf-4418-a769-5f86b02555f5', '47135fac-2ba7-430e-aa79-885cbd89d8a3', '8ed91fc4-ccf4-43e8-9fd6-bee86637776b', '248be449-5bfa-4d15-b867-9ed1e1f06637'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:51 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:51 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:51 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.382s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:51 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Deleted volume successfully. Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96d26cff-7788-4a68-a4c0-d2320369a8b9 tempest-VolumesSnapshotNegativeTestJSON-795898300 None] Lock "cinder-916657e8-956c-4492-aea6-4eb818bd4c92-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:51 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 1073741824" returned: 0 in 0.701s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:51 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 Aug 26 19:04:51 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:52 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3" returned: 0 in 0.314s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:04:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba2fc51-f40d-4c58-a154-beb14e3842b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775c7cfc-543c-482f-8d1f-2beef54e04c3', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee4a7ca-5690-442c-8fda-968196917693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:04:52 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Volume volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 (775c7cfc-543c-482f-8d1f-2beef54e04c3): created successfully Aug 26 19:04:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee4a7ca-5690-442c-8fda-968196917693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:04:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Flow 'volume_create_manager' (b4daffbc-d940-42a7-8f2c-2ed6fbd147a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:04:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-73171438-6839-4d65-b760-bd4cc4e771e3 tempest-VolumesListTestJSON-978237423 None] Created volume successfully. Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:54 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:54 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:54 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.396s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:04:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:04:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Acquiring lock "cinder-775c7cfc-543c-482f-8d1f-2beef54e04c3-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Lock "cinder-775c7cfc-543c-482f-8d1f-2beef54e04c3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Acquiring lock "cinder-quobyte-775c7cfc-543c-482f-8d1f-2beef54e04c3" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Lock "cinder-quobyte-775c7cfc-543c-482f-8d1f-2beef54e04c3" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:56 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[857e2366-a566-4afb-a1c5-683a82bbec5e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:56 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 Aug 26 19:04:56 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:56 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3" returned: 0 in 0.453s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:56 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3 Aug 26 19:04:56 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:57 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-775c7cfc-543c-482f-8d1f-2beef54e04c3" returned: 0 in 0.412s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Lock "cinder-quobyte-775c7cfc-543c-482f-8d1f-2beef54e04c3" released by "delete_volume" :: held 0.937s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Created reservations ['9dac02d9-04b6-4e7e-a195-5fdc3d056f22', 'd67881e0-b465-4e90-8f0e-e1b7678efde8', 'c54a6a42-c44b-4199-99ae-dbaa36dcfe0b', 'e5bfadbd-1b65-4f90-aa59-57c40c049a9d'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:57 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:04:57 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:57 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.378s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:04:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Deleted volume successfully. Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=145,cinder:UPDATE=207,cinder:DELETE=16,cinder:INSERT=55 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:04:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-51ae6c27-2c10-4bbd-9436-fe460adf5a5e tempest-VolumesListTestJSON-978237423 None] Lock "cinder-775c7cfc-543c-482f-8d1f-2beef54e04c3-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Acquiring lock "cinder-cfba9734-72e2-4f96-a426-581da59f14fc-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Lock "cinder-cfba9734-72e2-4f96-a426-581da59f14fc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:58 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=153,cinder:UPDATE=184,cinder:DELETE=18,cinder:INSERT=59 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:04:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Acquiring lock "cinder-quobyte-cfba9734-72e2-4f96-a426-581da59f14fc" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:04:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Lock "cinder-quobyte-cfba9734-72e2-4f96-a426-581da59f14fc" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:04:58 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48506e-9f1e-4f40-b2eb-4fcbdfcd251b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:04:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:59 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc Aug 26 19:04:59 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:59 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc" returned: 0 in 0.583s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:04:59 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc Aug 26 19:04:59 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:04:59 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Aug 26 19:04:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cfba9734-72e2-4f96-a426-581da59f14fc" returned: 0 in 0.348s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:04:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Lock "cinder-quobyte-cfba9734-72e2-4f96-a426-581da59f14fc" released by "delete_volume" :: held 1.033s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:04:59 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Created reservations ['ce74312c-7432-4c53-bfd2-1a115a566dca', 'bcb8e862-c6da-46fb-a62b-ed3625bb801e', '8625f511-f1b4-411f-a70d-c7a758ac5d18', '6053bcbf-3727-4ca0-a7c6-e90c451d60f3'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:00 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:00 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:00 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.407s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:00 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:00 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Deleted volume successfully. Aug 26 19:05:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-938c2833-9eb7-443d-86fd-809e2c55902e tempest-VolumesListTestJSON-978237423 None] Lock "cinder-cfba9734-72e2-4f96-a426-581da59f14fc-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Acquiring lock "cinder-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Lock "cinder-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Acquiring lock "cinder-quobyte-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Lock "cinder-quobyte-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0816af0e-bcfe-4769-b3ca-b325139a2050]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Flow 'volume_create_manager' (f8ddc152-3721-4f77-8096-04b0a58a772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97af121f-ae21-47c5-8bef-25d37c9ccabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:01 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 Aug 26 19:05:01 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97af121f-ae21-47c5-8bef-25d37c9ccabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7235c94e-57af-4453-ab65-b63e5e12bc70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d49fbeb86c6465397f71b7c58afe1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:01Z,use_quota=True,user_id='1d200a13557543d8ba2d4932e09365d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88e7d6e6-0d6c-498e-a564-17d0f3706106),volume_type_id=88e7d6e6-0d6c-498e-a564-17d0f3706106)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03899460-50a5-494b-9002-8f1f5c01dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03899460-50a5-494b-9002-8f1f5c01dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a060ba-8f0a-4225-b25a-d61fe6da5b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 19:05:01 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8" returned: 0 in 0.483s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:01 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8 Aug 26 19:05:01 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a060ba-8f0a-4225-b25a-d61fe6da5b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7235c94e-57af-4453-ab65-b63e5e12bc70', 'volume_name': 'volume-7235c94e-57af-4453-ab65-b63e5e12bc70', 'volume_size': 1, 'image_id': 'a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5d9ed7ebea307bfdaf598f78b196359a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d49fbeb86c6465397f71b7c58afe1cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '502acf7c98f9914348349119dfa77f105d2b34b13aae2fb917504e47752ddc50d7bde6d5b5183aaae6a378aeed3895d446d46fc94ac428f1da18dc0cb3aab82e', 'id': 'a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'created_at': datetime.datetime(2026, 8, 26, 17, 4, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753f06b9-8e98-4e6c-9722-c8e94e5c792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753f06b9-8e98-4e6c-9722-c8e94e5c792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d2c5b4-b83f-474d-bfd0-653232a1429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:02 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Volume 7235c94e-57af-4453-ab65-b63e5e12bc70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7235c94e-57af-4453-ab65-b63e5e12bc70', 'volume_size': 1, 'image_id': 'a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5d9ed7ebea307bfdaf598f78b196359a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d49fbeb86c6465397f71b7c58afe1cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '502acf7c98f9914348349119dfa77f105d2b34b13aae2fb917504e47752ddc50d7bde6d5b5183aaae6a378aeed3895d446d46fc94ac428f1da18dc0cb3aab82e', 'id': 'a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'created_at': datetime.datetime(2026, 8, 26, 17, 4, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Trying to clone 7235c94e-57af-4453-ab65-b63e5e12bc70 from image a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b at location (None, [{'url': 'file:///opt/stack/data/glance/images/a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 19:05:02 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8" returned: 0 in 0.366s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Lock "cinder-quobyte-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8" released by "delete_volume" :: held 0.918s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 19:05:02 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Image download 0.00 MB at 0.00 MB/s Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Created reservations ['c404a2a3-6776-4a00-9043-d9a9273fd4cb', '9199a1f3-d484-4f49-80c4-cc7392e9bb1e', '10ddfd68-0957-46aa-8a81-6d01ddb51e23', '94e38afc-472c-4fce-8b4b-03a564f76439'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b2d03e-97de-4ebb-aabc-b5c46a6c12c7]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:02 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:02 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:02 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD Aug 26 19:05:02 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Flow 'volume_create_manager' (ab188016-57e1-4021-841a-3bf26335c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd2d31d-e369-4de2-b091-12bca0cf0cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd2d31d-e369-4de2-b091-12bca0cf0cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433457312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11406a2-13d4-4b46-bb40-a04ab9ab673b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c86de7f9264dd8a6dcc1c9586b851f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:03Z,use_quota=True,user_id='06c1dc4999704488b6477f48177c034b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ac62a1-fc6e-4df2-8f0a-c3b9c651bdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ac62a1-fc6e-4df2-8f0a-c3b9c651bdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d17a79a-4558-40de-af24-89bcaeb8d0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d17a79a-4558-40de-af24-89bcaeb8d0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b11406a2-13d4-4b46-bb40-a04ab9ab673b', 'volume_name': 'volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ed336e-da7b-45b6-ad0f-b9862d7b994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ed336e-da7b-45b6-ad0f-b9862d7b994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd64520-aff1-42b7-bf5b-ecbec53847ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:02 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Volume b11406a2-13d4-4b46-bb40-a04ab9ab673b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b', 'volume_size': 1} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433457312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11406a2-13d4-4b46-bb40-a04ab9ab673b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c86de7f9264dd8a6dcc1c9586b851f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:03Z,use_quota=True,user_id='06c1dc4999704488b6477f48177c034b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Creating volume b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:02 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:03 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b 1073741824 Aug 26 19:05:03 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:03 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:03 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.471s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Deleted volume successfully. Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2eefd8b0-1f82-4176-87aa-7687a27068e5 tempest-VolumesListTestJSON-978237423 None] Lock "cinder-ca0d3b2f-6d2c-412a-a7c3-fdf61d511cf8-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:03 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD Aug 26 19:05:03 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:03 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD" returned: 1 in 0.451s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Temporary image a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b is fetched for user 1d200a13557543d8ba2d4932e09365d9. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de407a3-1046-4cce-975a-38d1083da4b8]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:03 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b 1073741824" returned: 0 in 0.686s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:03 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b Aug 26 19:05:03 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:03 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD Aug 26 19:05:03 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:04 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b" returned: 0 in 0.339s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd64520-aff1-42b7-bf5b-ecbec53847ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:04 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab4fb1b-c317-4dad-9aa3-8bc5d67815f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:04 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Volume volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b (b11406a2-13d4-4b46-bb40-a04ab9ab673b): created successfully Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab4fb1b-c317-4dad-9aa3-8bc5d67815f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Flow 'volume_create_manager' (ab188016-57e1-4021-841a-3bf26335c752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:04 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c08e7e65-b9d9-4128-822d-b697af8e7e1e tempest-VolumesActionsTest-1548357733 None] Created volume successfully. Aug 26 19:05:04 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD Aug 26 19:05:04 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:04 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7235c94e-57af-4453-ab65-b63e5e12bc70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d49fbeb86c6465397f71b7c58afe1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:01Z,use_quota=True,user_id='1d200a13557543d8ba2d4932e09365d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88e7d6e6-0d6c-498e-a564-17d0f3706106),volume_type_id=88e7d6e6-0d6c-498e-a564-17d0f3706106)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Creating volume 7235c94e-57af-4453-ab65-b63e5e12bc70 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:04 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:04 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 1073741824 Aug 26 19:05:04 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:05 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 1073741824" returned: 0 in 0.679s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:05 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 Aug 26 19:05:05 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:05 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70" returned: 0 in 0.380s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:05 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Attempting download of a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b ((None, [{'url': 'file:///opt/stack/data/glance/images/a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'metadata': {}}])) to volume 7235c94e-57af-4453-ab65-b63e5e12bc70. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 19:05:05 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f69f861-2830-4c1f-8b56-69244282f758]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_13tms7qo {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:05 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_13tms7qo Aug 26 19:05:05 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:06 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_13tms7qo" returned: 0 in 0.419s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_13tms7qo {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:06 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_13tms7qo Aug 26 19:05:06 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:06 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_13tms7qo" returned: 1 in 0.579s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_13tms7qo' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:05:06 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0660c35c-95a4-4c10-b413-0ec6ae807e1e]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:06 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD Aug 26 19:05:06 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:07 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:07 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD Aug 26 19:05:07 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:07 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD" returned: 1 in 0.662s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b was raw, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:07 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 Aug 26 19:05:07 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (08987846-2675-4eab-b32d-90cfc8012261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d80ce8-b536-4e93-86f5-fdc0815ecea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d80ce8-b536-4e93-86f5-fdc0815ecea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497552763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:08Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22b887a-59a4-44c5-8936-9d799c49f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22b887a-59a4-44c5-8936-9d799c49f29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082c658-0376-4548-8be8-6b04f13dc36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082c658-0376-4548-8be8-6b04f13dc36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d', 'volume_name': 'volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea156792-786f-414e-8e5b-3dcfad87de0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea156792-786f-414e-8e5b-3dcfad87de0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41332091-57ff-451a-9c94-7073ab71b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:08 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume 5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d', 'volume_size': 1} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497552763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:08Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Creating volume 5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:08 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:08 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d 1073741824 Aug 26 19:05:08 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:08 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70" returned: 0 in 0.784s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b_cc1o8ddjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:05:08 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:08 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d 1073741824" returned: 0 in 0.644s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:08 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 1G Aug 26 19:05:08 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:08 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d Aug 26 19:05:08 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:09 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d" returned: 0 in 0.415s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41332091-57ff-451a-9c94-7073ab71b034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21157d27-9961-4590-8eed-a6f6bcb2d74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:09 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d (5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d): created successfully Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21157d27-9961-4590-8eed-a6f6bcb2d74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (08987846-2675-4eab-b32d-90cfc8012261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:09 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 1G" returned: 0 in 0.675s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Downloaded image a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b ((None, [{'url': 'file:///opt/stack/data/glance/images/a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'metadata': {}}])) to volume 7235c94e-57af-4453-ab65-b63e5e12bc70 successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Temporary image a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b for user 1d200a13557543d8ba2d4932e09365d9 is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Marking volume 7235c94e-57af-4453-ab65-b63e5e12bc70 as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 19:05:09 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ed1cc70f-83bb-4361-83a3-b3b0a2c1a178 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created volume successfully. Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Copying metadata from image a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b to 7235c94e-57af-4453-ab65-b63e5e12bc70. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Creating volume glance metadata for volume 7235c94e-57af-4453-ab65-b63e5e12bc70 backed by image a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5d9ed7ebea307bfdaf598f78b196359a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d2c5b4-b83f-474d-bfd0-653232a1429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7235c94e-57af-4453-ab65-b63e5e12bc70', 'volume_size': 1, 'image_id': 'a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5d9ed7ebea307bfdaf598f78b196359a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d49fbeb86c6465397f71b7c58afe1cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '502acf7c98f9914348349119dfa77f105d2b34b13aae2fb917504e47752ddc50d7bde6d5b5183aaae6a378aeed3895d446d46fc94ac428f1da18dc0cb3aab82e', 'id': 'a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b', 'created_at': datetime.datetime(2026, 8, 26, 17, 4, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a74b874f-25a3-4ff4-81fa-4aee5d9d7d1b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692f38a5-6a58-4449-9385-d4cafe07c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:09 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Volume volume-7235c94e-57af-4453-ab65-b63e5e12bc70 (7235c94e-57af-4453-ab65-b63e5e12bc70): created successfully Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692f38a5-6a58-4449-9385-d4cafe07c070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Flow 'volume_create_manager' (f8ddc152-3721-4f77-8096-04b0a58a772e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:09 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b80a457c-6ad8-4e17-8bee-47f52996984f tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Created volume successfully. Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Acquiring lock "cinder-7235c94e-57af-4453-ab65-b63e5e12bc70-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "cinder-7235c94e-57af-4453-ab65-b63e5e12bc70-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Acquiring lock "cinder-quobyte-7235c94e-57af-4453-ab65-b63e5e12bc70" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "cinder-quobyte-7235c94e-57af-4453-ab65-b63e5e12bc70" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[634441c4-e2a6-46a1-8c19-f729f064f0f7]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:10 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 Aug 26 19:05:10 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (509b9257-4d61-4670-ab87-7860b1172bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358c5f91-07de-471f-a221-b2fc398327f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358c5f91-07de-471f-a221-b2fc398327f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481592797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27aa955-0a6d-420e-9596-1311d68e7e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:11Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f2c343-4214-4762-a028-c1a114f5da7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f2c343-4214-4762-a028-c1a114f5da7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06a8070-1f80-4835-bdb5-07abffd8c124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06a8070-1f80-4835-bdb5-07abffd8c124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27aa955-0a6d-420e-9596-1311d68e7e9d', 'volume_name': 'volume-b27aa955-0a6d-420e-9596-1311d68e7e9d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df0a08b-647f-4d60-89c3-93f81ae45932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df0a08b-647f-4d60-89c3-93f81ae45932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39621c3f-62be-40b3-b2ae-7fb204e5038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:10 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume b27aa955-0a6d-420e-9596-1311d68e7e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27aa955-0a6d-420e-9596-1311d68e7e9d', 'volume_size': 1} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1481592797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27aa955-0a6d-420e-9596-1311d68e7e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:11Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Creating volume b27aa955-0a6d-420e-9596-1311d68e7e9d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:10 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:10 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d 1073741824 Aug 26 19:05:10 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:11 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70" returned: 0 in 0.642s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:11 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70 Aug 26 19:05:11 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (bababad3-1363-432c-a25e-27d37ac3a4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed80b2a9-4c28-44f5-9294-30fb52b4aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed80b2a9-4c28-44f5-9294-30fb52b4aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573819006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:11Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be646118-69b7-45bb-918a-67c8e2c9f731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be646118-69b7-45bb-918a-67c8e2c9f731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae38c3ce-de53-4059-ae70-bbfcd62ff8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae38c3ce-de53-4059-ae70-bbfcd62ff8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d', 'volume_name': 'volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013ff2b6-0777-4ca5-be74-dd0c07dd1581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013ff2b6-0777-4ca5-be74-dd0c07dd1581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9d6c20-02cb-40f3-af38-c3ba0cd9a6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:11 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume 6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d', 'volume_size': 1} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:11 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7235c94e-57af-4453-ab65-b63e5e12bc70" returned: 0 in 0.476s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "cinder-quobyte-7235c94e-57af-4453-ab65-b63e5e12bc70" released by "delete_volume" :: held 1.182s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:11 devstack cinder-volume[93671]: WARNING cinder.quota [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:05:11 devstack cinder-volume[93671]: WARNING cinder.quota [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Created reservations ['763e0724-18fb-48b5-9c67-9c666a88418f', '0c94c20c-9650-475f-afc6-7c9970c242cc', 'fc7ba2e8-cf0a-4650-ab62-e0b2f3958f6d', '8f6bc8e7-2643-450c-9472-87e34a21a1d3'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:11 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d 1073741824" returned: 0 in 0.927s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:11 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d Aug 26 19:05:11 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:11 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:11 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (c5b6fa61-7f82-4e8f-b8e9-136c08e35bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f818c380-8989-4550-87e3-46b8d0f92341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:12 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d" returned: 0 in 0.802s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:12 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.087s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573819006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:11Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Creating volume 6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:12 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:12 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d 1073741824 Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f818c380-8989-4550-87e3-46b8d0f92341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-48082170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68fce0e-1d1b-4965-9b7e-cd52fec59254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:12Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:12 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1baca94c-bf40-4044-b4c9-66516a9c1687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1baca94c-bf40-4044-b4c9-66516a9c1687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d6bce5-bfb4-423d-8baa-84d517332326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d6bce5-bfb4-423d-8baa-84d517332326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a68fce0e-1d1b-4965-9b7e-cd52fec59254', 'volume_name': 'volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b7d22f-ccdc-49b8-85fa-0e84cb8efeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b7d22f-ccdc-49b8-85fa-0e84cb8efeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fd2035-acc9-4612-8f22-453d7a5b6b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:12 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume a68fce0e-1d1b-4965-9b7e-cd52fec59254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254', 'volume_size': 1} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 1.054s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39621c3f-62be-40b3-b2ae-7fb204e5038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27aa955-0a6d-420e-9596-1311d68e7e9d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c723cf04-0f9c-4120-87e7-f7bccfbfce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Deleted volume successfully. Aug 26 19:05:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume volume-b27aa955-0a6d-420e-9596-1311d68e7e9d (b27aa955-0a6d-420e-9596-1311d68e7e9d): created successfully Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c723cf04-0f9c-4120-87e7-f7bccfbfce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (509b9257-4d61-4670-ab87-7860b1172bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e55c995d-bcc6-42f0-a15c-06f7e7f382bf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created volume successfully. Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61563110-8804-48b1-ad71-ea86dfd8d4e0 tempest-VolumeAndVolumeTypeFromImageTest-2108485436 None] Lock "cinder-7235c94e-57af-4453-ab65-b63e5e12bc70-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (e528e166-fbef-410d-b8b4-9751affde491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc80292-dadf-4193-b1ad-ae74c62d131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc80292-dadf-4193-b1ad-ae74c62d131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-961432778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb63a45c-aa04-49b6-9f6f-d93332f03f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:14Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22801ab-78e9-4f2f-b0a4-ec88faf1d981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22801ab-78e9-4f2f-b0a4-ec88faf1d981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26076dae-fd2a-41f2-b6ef-3cee4c8787d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26076dae-fd2a-41f2-b6ef-3cee4c8787d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb63a45c-aa04-49b6-9f6f-d93332f03f68', 'volume_name': 'volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac46d254-f27b-4f3c-bd0f-83d56552958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac46d254-f27b-4f3c-bd0f-83d56552958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018d6f42-2ed3-4156-9e2a-47a98747a268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume eb63a45c-aa04-49b6-9f6f-d93332f03f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68', 'volume_size': 1} Aug 26 19:05:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:14 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d 1073741824" returned: 0 in 1.534s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:14 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d Aug 26 19:05:14 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (fa891a37-e0c6-460b-9f87-9d55d47bb64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb5b96c-1528-45a7-8ea4-14b1f9d12459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb5b96c-1528-45a7-8ea4-14b1f9d12459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-53170805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:14Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d3bdb1-efef-44c0-a7e6-e25a04fbd4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d3bdb1-efef-44c0-a7e6-e25a04fbd4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dc3242-fd8d-426c-88cd-513262254556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dc3242-fd8d-426c-88cd-513262254556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0', 'volume_name': 'volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b7209d-0c36-4d97-aa6c-dfb550c644df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b7209d-0c36-4d97-aa6c-dfb550c644df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16af9c40-d1a0-45ee-a218-83a7572b3919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:14 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0', 'volume_size': 1} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:14 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d" returned: 0 in 0.465s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-48082170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68fce0e-1d1b-4965-9b7e-cd52fec59254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:12Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Creating volume a68fce0e-1d1b-4965-9b7e-cd52fec59254 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:14 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9d6c20-02cb-40f3-af38-c3ba0cd9a6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be38b36f-db70-4987-a102-d0fc167c2376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:14 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d (6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d): created successfully Aug 26 19:05:14 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 1073741824 Aug 26 19:05:14 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be38b36f-db70-4987-a102-d0fc167c2376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (bababad3-1363-432c-a25e-27d37ac3a4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ad8530e0-d4fc-45c0-bd9a-8c522d14ec9e tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created volume successfully. Aug 26 19:05:15 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 1073741824" returned: 0 in 0.871s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:15 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 Aug 26 19:05:15 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:16 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254" returned: 0 in 0.494s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.380s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-961432778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb63a45c-aa04-49b6-9f6f-d93332f03f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:14Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Creating volume eb63a45c-aa04-49b6-9f6f-d93332f03f68 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:16 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:16 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 1073741824 Aug 26 19:05:16 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fd2035-acc9-4612-8f22-453d7a5b6b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1fd8b6-e28f-440a-9b5b-bd338e5a7abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:16 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 (a68fce0e-1d1b-4965-9b7e-cd52fec59254): created successfully Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1fd8b6-e28f-440a-9b5b-bd338e5a7abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (c5b6fa61-7f82-4e8f-b8e9-136c08e35bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:16 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e8a82851-8471-4cc2-b66e-9ef4eae77b26 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created volume successfully. Aug 26 19:05:17 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 1073741824" returned: 0 in 0.904s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:17 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 Aug 26 19:05:17 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:17 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68" returned: 0 in 0.388s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-53170805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d34adde35f43479b9b22bb58f85c95fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:14Z,use_quota=True,user_id='1aaa8451f4a7413aac0e7dd5f6345150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Creating volume cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:17 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018d6f42-2ed3-4156-9e2a-47a98747a268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:17 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 1073741824 Aug 26 19:05:17 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355ff2a7-fe5e-400d-a590-f83fe4d6dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:17 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 (eb63a45c-aa04-49b6-9f6f-d93332f03f68): created successfully Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355ff2a7-fe5e-400d-a590-f83fe4d6dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (e528e166-fbef-410d-b8b4-9751affde491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-69ea2ef9-fb75-4809-9552-0b856cc05ea7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created volume successfully. Aug 26 19:05:18 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 1073741824" returned: 0 in 0.925s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:18 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 Aug 26 19:05:18 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:19 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0" returned: 0 in 0.772s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16af9c40-d1a0-45ee-a218-83a7572b3919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e7b73f-f560-4d76-8957-2ded68555c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:19 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Volume volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 (cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0): created successfully Aug 26 19:05:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e7b73f-f560-4d76-8957-2ded68555c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Flow 'volume_create_manager' (fa891a37-e0c6-460b-9f87-9d55d47bb64e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ccb79300-8cc6-4a24-8876-d492a952d7ab tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created volume successfully. Aug 26 19:05:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-quobyte-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9658af88-6c39-4710-af5c-b9bf753a48d4]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:20 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 Aug 26 19:05:20 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:21 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0" returned: 0 in 0.711s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:21 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0 Aug 26 19:05:21 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e9efffbc-3aa9-43a1-8b58-bcc2402a070e tempest-VolumesActionsTest-1548357733 None] Acquiring lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b" by "attach_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e9efffbc-3aa9-43a1-8b58-bcc2402a070e tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b" acquired by "attach_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e9efffbc-3aa9-43a1-8b58-bcc2402a070e tempest-VolumesActionsTest-1548357733 None] Attaching volume b11406a2-13d4-4b46-bb40-a04ab9ab673b to instance 9967ed5e-3931-4aca-ada7-3060f360bbcf at mountpoint /dev/vdb on host None. Aug 26 19:05:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e9efffbc-3aa9-43a1-8b58-bcc2402a070e tempest-VolumesActionsTest-1548357733 None] Attach volume completed successfully. Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e9efffbc-3aa9-43a1-8b58-bcc2402a070e tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b" released by "attach_volume" :: held 0.155s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:21 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0" returned: 0 in 0.443s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0" released by "delete_volume" :: held 1.236s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7b8d7a3d-6ee7-4636-b31e-a14230282bb1 tempest-VolumesActionsTest-1548357733 None] Acquiring lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b-detach_volume" by "detach_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7b8d7a3d-6ee7-4636-b31e-a14230282bb1 tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7b8d7a3d-6ee7-4636-b31e-a14230282bb1 tempest-VolumesActionsTest-1548357733 None] Detaching volume b11406a2-13d4-4b46-bb40-a04ab9ab673b from instance 9967ed5e-3931-4aca-ada7-3060f360bbcf. Aug 26 19:05:21 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created reservations ['80b6359d-0030-46fa-9e3e-cf39f2d71ac0', '0616c110-b2a0-474f-aa75-48058aba3c0e', '4b8f868f-56fe-4268-8d76-dfa829953fe1', '86687334-1e12-4f59-a429-66896e056a3e'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7b8d7a3d-6ee7-4636-b31e-a14230282bb1 tempest-VolumesActionsTest-1548357733 None] Detach volume completed successfully. Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7b8d7a3d-6ee7-4636-b31e-a14230282bb1 tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:22 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:22 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:22 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.573s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Deleted volume successfully. Aug 26 19:05:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6059723-2f47-46d6-9b82-0c6cca8fdfcf tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-cd22aa73-4ad4-431e-8b5d-61fcf4d7f7c0-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-eb63a45c-aa04-49b6-9f6f-d93332f03f68-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-eb63a45c-aa04-49b6-9f6f-d93332f03f68-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-quobyte-eb63a45c-aa04-49b6-9f6f-d93332f03f68" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-eb63a45c-aa04-49b6-9f6f-d93332f03f68" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:23 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[33675cec-25bd-4b93-b3e5-0c5fa2a24cf5]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:23 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 Aug 26 19:05:23 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:23 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68" returned: 0 in 0.710s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:23 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68 Aug 26 19:05:23 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:24 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-eb63a45c-aa04-49b6-9f6f-d93332f03f68" returned: 0 in 0.378s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-eb63a45c-aa04-49b6-9f6f-d93332f03f68" released by "delete_volume" :: held 1.155s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created reservations ['5fc93a2b-2c19-4b3f-804e-49fd52d0a157', 'd40feb98-49c6-4fd2-81b4-b314222f7456', '5203add1-f3ac-40c9-9e9f-c4996aad0161', '04f6270f-9bd0-4ebf-8b31-e87dff0c4886'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:24 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:24 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:24 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.469s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:24 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:24 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Deleted volume successfully. Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e39e851d-e0a2-409a-b976-96eb86b996c4 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-eb63a45c-aa04-49b6-9f6f-d93332f03f68-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-a68fce0e-1d1b-4965-9b7e-cd52fec59254-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-a68fce0e-1d1b-4965-9b7e-cd52fec59254-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-quobyte-a68fce0e-1d1b-4965-9b7e-cd52fec59254" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-a68fce0e-1d1b-4965-9b7e-cd52fec59254" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7c6de0-80a3-4279-ab22-810287658cb7]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:25 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 Aug 26 19:05:25 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Flow 'volume_create_manager' (dd6d6c3b-b889-4ad6-b128-c073b61a0a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2971f461-92b5-44ec-bba1-2a2287b60e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2971f461-92b5-44ec-bba1-2a2287b60e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310669819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde0efbd-2d54-428c-a25d-38d970cddf8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f158490c98a4dce9d68d2e3e3c00655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:26Z,use_quota=True,user_id='d13bcb087954490d9d901f2ee603e5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28cbf8b-501f-4a7e-88ca-5ecf7fb2ec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28cbf8b-501f-4a7e-88ca-5ecf7fb2ec48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d88e6c8-60b0-4ea7-9112-83fc94623228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d88e6c8-60b0-4ea7-9112-83fc94623228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde0efbd-2d54-428c-a25d-38d970cddf8f', 'volume_name': 'volume-dde0efbd-2d54-428c-a25d-38d970cddf8f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:26 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2bb772-f723-4ecb-87f5-7031229f380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2bb772-f723-4ecb-87f5-7031229f380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27abb58-95e9-431b-909f-3ba32d899d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:26 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Volume dde0efbd-2d54-428c-a25d-38d970cddf8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde0efbd-2d54-428c-a25d-38d970cddf8f', 'volume_size': 1} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310669819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde0efbd-2d54-428c-a25d-38d970cddf8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f158490c98a4dce9d68d2e3e3c00655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:26Z,use_quota=True,user_id='d13bcb087954490d9d901f2ee603e5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Creating volume dde0efbd-2d54-428c-a25d-38d970cddf8f {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:26 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254" returned: 0 in 0.517s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:26 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f 1073741824 Aug 26 19:05:26 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:26 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254 Aug 26 19:05:26 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:26 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a68fce0e-1d1b-4965-9b7e-cd52fec59254" returned: 0 in 0.313s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-a68fce0e-1d1b-4965-9b7e-cd52fec59254" released by "delete_volume" :: held 0.900s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created reservations ['2caf9f0c-c924-48dd-9b82-e4f9c5431ee0', 'a32ae361-16dc-4f0b-ab29-571d06ed02b2', '7a5374a8-a3c8-4807-8cf5-515956189e1d', 'ba1eb846-01e4-4279-a836-344bfb56fb64'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:26 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:26 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:26 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f 1073741824" returned: 0 in 0.701s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:26 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f Aug 26 19:05:26 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:26 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.325s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:26 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Deleted volume successfully. Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-07b50863-37c0-44b4-87b4-f9f79d255ab7 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-a68fce0e-1d1b-4965-9b7e-cd52fec59254-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:27 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f" returned: 0 in 0.330s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27abb58-95e9-431b-909f-3ba32d899d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde0efbd-2d54-428c-a25d-38d970cddf8f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e42f5d-afed-403e-8ada-11552b1441d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:27 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Volume volume-dde0efbd-2d54-428c-a25d-38d970cddf8f (dde0efbd-2d54-428c-a25d-38d970cddf8f): created successfully Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e42f5d-afed-403e-8ada-11552b1441d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Flow 'volume_create_manager' (dd6d6c3b-b889-4ad6-b128-c073b61a0a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:27 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e4c54f1a-a251-414d-b241-c31007cb58c3 tempest-ProjectReaderTests-1200305403 None] Created volume successfully. Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-quobyte-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[949267f8-50d7-47cd-8264-c85e1452dfbe]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:28 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d Aug 26 19:05:28 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Acquiring lock "cinder-dde0efbd-2d54-428c-a25d-38d970cddf8f-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Lock "cinder-dde0efbd-2d54-428c-a25d-38d970cddf8f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Acquiring lock "cinder-quobyte-dde0efbd-2d54-428c-a25d-38d970cddf8f" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Lock "cinder-quobyte-dde0efbd-2d54-428c-a25d-38d970cddf8f" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[145ec249-3150-4a15-80fe-f8436a04eef3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:28 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d" returned: 0 in 0.639s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:28 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d Aug 26 19:05:28 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:28 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f Aug 26 19:05:28 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:28 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:28 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f" returned: 0 in 0.481s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d" returned: 0 in 0.442s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:28 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f Aug 26 19:05:28 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d" released by "delete_volume" :: held 1.158s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created reservations ['263038ca-b3eb-4d23-9c1e-a6ff90cbdd07', 'c8ff2b25-9b9d-4670-b903-e90e5697bee3', 'bf053d4d-9ef5-49f5-87e4-c5bf7e16c2eb', '1f2da7cd-6ce7-4ff4-987b-c23cd992f617'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:29 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:29 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:29 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dde0efbd-2d54-428c-a25d-38d970cddf8f" returned: 0 in 0.498s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Lock "cinder-quobyte-dde0efbd-2d54-428c-a25d-38d970cddf8f" released by "delete_volume" :: held 1.056s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:29 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.395s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Created reservations ['80cd7abb-8171-4b1d-8ade-f59612a16464', 'c6308ee2-2bbc-4d14-92bb-ba4604bb59b2', 'db3bc933-073c-4f11-af10-0e08c68e0cbf', 'e5de3986-aeb3-4b8c-8b43-797b572cd335'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Deleted volume successfully. Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-970f7079-f0bb-418f-bc58-aa52a7575c38 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-6dbc2fa3-6bc0-46f5-86b8-33b815b03f3d-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:29 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:29 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:30 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.309s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Deleted volume successfully. Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-489d6463-fadb-444c-a362-08aabdfc6b28 tempest-ProjectReaderTests-1200305403 None] Lock "cinder-dde0efbd-2d54-428c-a25d-38d970cddf8f-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-b27aa955-0a6d-420e-9596-1311d68e7e9d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-b27aa955-0a6d-420e-9596-1311d68e7e9d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-quobyte-b27aa955-0a6d-420e-9596-1311d68e7e9d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-b27aa955-0a6d-420e-9596-1311d68e7e9d" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcddc9b5-9288-48fe-8271-5e97ca835383]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:30 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d Aug 26 19:05:30 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:30 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d" returned: 0 in 0.654s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:30 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d Aug 26 19:05:30 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:31 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b27aa955-0a6d-420e-9596-1311d68e7e9d" returned: 0 in 0.403s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-b27aa955-0a6d-420e-9596-1311d68e7e9d" released by "delete_volume" :: held 1.125s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created reservations ['f80368bc-5558-4044-a074-d9d1fdba6af6', '7d4dfdcb-484e-4e78-8561-c4017f88074c', 'b8735367-3e3c-49e0-85ad-d912f50e69a6', 'b78a8205-b584-43fd-9a9b-6cd5841eaf5a'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Flow 'volume_create_manager' (8223b489-8326-439c-a7c8-a7cbf3d0772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565dfd7d-7e85-4273-a1d2-c3b1e0838646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565dfd7d-7e85-4273-a1d2-c3b1e0838646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657631600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1780dc31-d981-41ed-b316-957cc3cc6899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f158490c98a4dce9d68d2e3e3c00655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:31Z,use_quota=True,user_id='d13bcb087954490d9d901f2ee603e5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65f612b-480a-4658-a6c3-34e12afb87bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65f612b-480a-4658-a6c3-34e12afb87bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654276c8-467e-4715-95e2-931e95e65e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654276c8-467e-4715-95e2-931e95e65e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1780dc31-d981-41ed-b316-957cc3cc6899', 'volume_name': 'volume-1780dc31-d981-41ed-b316-957cc3cc6899', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fd21c9-9bfd-43a9-a010-72824f970ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fd21c9-9bfd-43a9-a010-72824f970ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77af956d-501c-406b-b077-2a28a3a9c4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Volume 1780dc31-d981-41ed-b316-957cc3cc6899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1780dc31-d981-41ed-b316-957cc3cc6899', 'volume_size': 1} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657631600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1780dc31-d981-41ed-b316-957cc3cc6899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f158490c98a4dce9d68d2e3e3c00655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:31Z,use_quota=True,user_id='d13bcb087954490d9d901f2ee603e5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Creating volume 1780dc31-d981-41ed-b316-957cc3cc6899 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:31 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:31 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899 1073741824 Aug 26 19:05:31 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:31 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:31 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:32 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.440s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Deleted volume successfully. Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79b90948-c150-4d10-adaf-234a3f788998 tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-b27aa955-0a6d-420e-9596-1311d68e7e9d-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:32 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899 1073741824" returned: 0 in 0.785s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:32 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899 Aug 26 19:05:32 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "cinder-quobyte-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[830b8cc4-7832-4949-b763-54ce12e1adab]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:32 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899" returned: 0 in 0.355s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77af956d-501c-406b-b077-2a28a3a9c4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1780dc31-d981-41ed-b316-957cc3cc6899', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1600526b-a45b-49b0-9801-37ed1cae3fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:32 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Volume volume-1780dc31-d981-41ed-b316-957cc3cc6899 (1780dc31-d981-41ed-b316-957cc3cc6899): created successfully Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1600526b-a45b-49b0-9801-37ed1cae3fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Flow 'volume_create_manager' (8223b489-8326-439c-a7c8-a7cbf3d0772f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-817a0f51-506a-4457-9945-1e0e4247021d tempest-ProjectReaderTests-1200305403 None] Created volume successfully. Aug 26 19:05:32 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d Aug 26 19:05:32 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:33 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d" returned: 0 in 0.473s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:33 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d Aug 26 19:05:33 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Acquiring lock "cinder-1780dc31-d981-41ed-b316-957cc3cc6899-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Lock "cinder-1780dc31-d981-41ed-b316-957cc3cc6899-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:33 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d" returned: 0 in 0.464s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-quobyte-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d" released by "delete_volume" :: held 1.004s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Acquiring lock "cinder-quobyte-1780dc31-d981-41ed-b316-957cc3cc6899" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Lock "cinder-quobyte-1780dc31-d981-41ed-b316-957cc3cc6899" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Created reservations ['b091ec05-d5ad-4edf-b122-6113c9e7fa4d', 'e102390e-f078-4ddf-a905-e4d4f0975214', '9e06f648-50f7-45b0-858b-bd60ecc5434e', '1695e24d-4316-4d80-aacd-74d8e718b63f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[825916da-4190-4a12-8eb4-69281725572c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:33 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899 Aug 26 19:05:33 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:33 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:33 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:34 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.265s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:34 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Deleted volume successfully. Aug 26 19:05:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a4ae9dd-96e9-48e6-9c69-1d438e78984d tempest-CreateVolumesFromSourceVolumeTest-1520285132 None] Lock "cinder-5fc3e2e4-f496-4a10-a6d6-6e46b39fa97d-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:34 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899" returned: 0 in 0.478s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:34 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899 Aug 26 19:05:34 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:34 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1780dc31-d981-41ed-b316-957cc3cc6899" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Lock "cinder-quobyte-1780dc31-d981-41ed-b316-957cc3cc6899" released by "delete_volume" :: held 0.837s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:34 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Created reservations ['4d199a3d-8760-4c03-a860-08b52161ad6c', '605eeadf-7d23-4d3b-8de7-2bb0f7393c87', 'c7b97740-5f7d-44b5-bfe8-6f19567c2e1b', 'b37b50c9-d26e-4495-aa4b-50b9ad5a340a'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:35 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:35 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:35 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.378s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:35 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Deleted volume successfully. Aug 26 19:05:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f17c3815-e89e-414b-b7cc-54d1d6bee5c8 tempest-ProjectReaderTests-1200305403 None] Lock "cinder-1780dc31-d981-41ed-b316-957cc3cc6899-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Flow 'volume_create_manager' (6858d13f-6186-4ad2-ae1d-485dae27d5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de40f3e-9854-4a15-8152-0f1f9605630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de40f3e-9854-4a15-8152-0f1f9605630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-247233716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d8586c-c718-44f1-ae7f-6a97e9812a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c7e2c53b74feebeedc7d7e04f8187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:37Z,use_quota=True,user_id='6791dc9840e34946ba16dce40dec11bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790e472a-1f37-473b-b2a3-fd904ae9771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790e472a-1f37-473b-b2a3-fd904ae9771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2ea1e1-b194-4840-87aa-47abeae13876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2ea1e1-b194-4840-87aa-47abeae13876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d8586c-c718-44f1-ae7f-6a97e9812a73', 'volume_name': 'volume-80d8586c-c718-44f1-ae7f-6a97e9812a73', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce12798-4ff7-471d-966e-fcd3b547af89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce12798-4ff7-471d-966e-fcd3b547af89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4aff83-d2e0-4600-b164-861a095f7ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:37 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Volume 80d8586c-c718-44f1-ae7f-6a97e9812a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d8586c-c718-44f1-ae7f-6a97e9812a73', 'volume_size': 1} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-247233716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d8586c-c718-44f1-ae7f-6a97e9812a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c7e2c53b74feebeedc7d7e04f8187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:37Z,use_quota=True,user_id='6791dc9840e34946ba16dce40dec11bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Creating volume 80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:37 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:37 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 1073741824 Aug 26 19:05:37 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:38 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 1073741824" returned: 0 in 0.909s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:38 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 Aug 26 19:05:38 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:39 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73" returned: 0 in 0.444s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4aff83-d2e0-4600-b164-861a095f7ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d8586c-c718-44f1-ae7f-6a97e9812a73', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba84d2d-b839-46bb-83c8-3b32ad05832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:39 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Volume volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 (80d8586c-c718-44f1-ae7f-6a97e9812a73): created successfully Aug 26 19:05:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba84d2d-b839-46bb-83c8-3b32ad05832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Flow 'volume_create_manager' (6858d13f-6186-4ad2-ae1d-485dae27d5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:39 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-cd0f8136-e0a7-401e-aa64-9252d8e411c4 tempest-SnapshotDependencyTests-2069239439 None] Created volume successfully. Aug 26 19:05:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Creating offline snapshot ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 of volume 80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:05:40 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c016ec8a-bb35-4337-aff2-342571e3cd09]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:40 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 Aug 26 19:05:40 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:41 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73" returned: 0 in 0.767s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:41 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 1G Aug 26 19:05:41 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c35c65dd-f52d-4e1d-b1a1-05c74c21e65f tempest-VolumesActionsTest-1548357733 None] Acquiring lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b" by "attach_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c35c65dd-f52d-4e1d-b1a1-05c74c21e65f tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b" acquired by "attach_volume" :: waited 0.038s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c35c65dd-f52d-4e1d-b1a1-05c74c21e65f tempest-VolumesActionsTest-1548357733 None] Attaching volume b11406a2-13d4-4b46-bb40-a04ab9ab673b to instance a87109a0-f366-4c2b-985d-cab450329299 at mountpoint /dev/vdb on host None. Aug 26 19:05:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c35c65dd-f52d-4e1d-b1a1-05c74c21e65f tempest-VolumesActionsTest-1548357733 None] Attach volume completed successfully. Aug 26 19:05:41 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c35c65dd-f52d-4e1d-b1a1-05c74c21e65f tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b" released by "attach_volume" :: held 0.158s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 1G" returned: 0 in 0.854s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:41 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 Aug 26 19:05:41 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2c8ae7ea-f4c8-4cc4-a42f-86c0b938b4c5 tempest-VolumesActionsTest-1548357733 None] Acquiring lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b-detach_volume" by "detach_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2c8ae7ea-f4c8-4cc4-a42f-86c0b938b4c5 tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:42 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2c8ae7ea-f4c8-4cc4-a42f-86c0b938b4c5 tempest-VolumesActionsTest-1548357733 None] Detaching volume b11406a2-13d4-4b46-bb40-a04ab9ab673b from instance a87109a0-f366-4c2b-985d-cab450329299. Aug 26 19:05:42 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2c8ae7ea-f4c8-4cc4-a42f-86c0b938b4c5 tempest-VolumesActionsTest-1548357733 None] Detach volume completed successfully. Aug 26 19:05:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2c8ae7ea-f4c8-4cc4-a42f-86c0b938b4c5 tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:42 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298" returned: 0 in 0.681s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:42 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 is being set with open permissions: ugo+rw Aug 26 19:05:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:42 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 Aug 26 19:05:42 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:42 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Flow 'volume_create_manager' (62196f93-1d44-4dda-ac71-36110358c5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:42 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feff4049-f0e0-413b-bf71-dae2e0aabf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feff4049-f0e0-413b-bf71-dae2e0aabf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1077011077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67158e405ff4203a5d0d86002609f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:43Z,use_quota=True,user_id='9d5604513c244c8c9a3f6893c3282dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c1d315-df82-471f-985c-0b58cf7b6c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c1d315-df82-471f-985c-0b58cf7b6c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9b0be7-f26d-4283-8ba0-bb0c7ce03a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9b0be7-f26d-4283-8ba0-bb0c7ce03a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8', 'volume_name': 'volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd78de94-9c2e-41c6-9c34-7b77638dd468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd78de94-9c2e-41c6-9c34-7b77638dd468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:43 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b873f9ed-5d93-4c28-9d4a-eaf936987f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:43 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Volume b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8', 'volume_size': 1} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298" returned: 0 in 0.505s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:43 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.info Aug 26 19:05:43 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:43 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.info" returned: 0 in 0.311s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:43 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.info is being set with open permissions: ugo+rw Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:43 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.info Aug 26 19:05:43 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:43 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.info" returned: 0 in 0.515s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.775s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.897s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1077011077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67158e405ff4203a5d0d86002609f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:43Z,use_quota=True,user_id='9d5604513c244c8c9a3f6893c3282dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Creating volume b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:44 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:44 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 1073741824 Aug 26 19:05:44 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:44 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f71d5dc5-5213-4250-af84-a10cb2bf3d1f tempest-SnapshotDependencyTests-2069239439 None] Create snapshot completed successfully Aug 26 19:05:44 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 1073741824" returned: 0 in 0.855s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:44 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 Aug 26 19:05:44 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:45 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" returned: 0 in 0.374s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b873f9ed-5d93-4c28-9d4a-eaf936987f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e87d55-f043-44a3-bbde-ba7da271d553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:45 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Volume volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 (b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8): created successfully Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e87d55-f043-44a3-bbde-ba7da271d553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Flow 'volume_create_manager' (62196f93-1d44-4dda-ac71-36110358c5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7c51c2dd-0397-4fce-8ff4-5a0219ad283c tempest-VolumeDependencyTests-1342370326 None] Created volume successfully. Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Flow 'volume_create_manager' (5157e602-d235-4fb1-ab5e-46fda2d26930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3b6174-278b-4de5-9282-bcec5ba3f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3b6174-278b-4de5-9282-bcec5ba3f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6068b378-6df6-4097-b4ef-4446960e512b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c7e2c53b74feebeedc7d7e04f8187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:46Z,use_quota=True,user_id='6791dc9840e34946ba16dce40dec11bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cac31b2-4c89-412d-8d31-6f2e7946a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cac31b2-4c89-412d-8d31-6f2e7946a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bea5fd1-5cbf-4bd1-89bf-0dd4d4bda08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bea5fd1-5cbf-4bd1-89bf-0dd4d4bda08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6068b378-6df6-4097-b4ef-4446960e512b', 'volume_name': 'volume-6068b378-6df6-4097-b4ef-4446960e512b', 'volume_size': 1, 'snapshot_id': 'ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0b6e73-1a96-412a-9da2-6a1160a3422f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0b6e73-1a96-412a-9da2-6a1160a3422f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b47b85-3d27-4d1d-8632-e26ddc2d83b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:45 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Volume 6068b378-6df6-4097-b4ef-4446960e512b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6068b378-6df6-4097-b4ef-4446960e512b', 'volume_size': 1, 'snapshot_id': 'ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298'} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "cinder-quobyte-ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298-6068b378-6df6-4097-b4ef-4446960e512b" by "_create_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298-6068b378-6df6-4097-b4ef-4446960e512b" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Creating volume 6068b378-6df6-4097-b4ef-4446960e512b from snapshot ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 {{(pid=93671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:05:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "cinder-quobyte-6068b378-6df6-4097-b4ef-4446960e512b" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-6068b378-6df6-4097-b4ef-4446960e512b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] snapshot: ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298, volume: 6068b378-6df6-4097-b4ef-4446960e512b, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[559abf0d-8ef6-41d2-87f7-0e24764bf4dd]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:46 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 Aug 26 19:05:46 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:46 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298" returned: 0 in 0.536s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d8586c-c718-44f1-ae7f-6a97e9812a73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb2d6a3-b137-48cb-9f3b-95934558babf]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:46 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 Aug 26 19:05:46 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:47 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73" returned: 0 in 0.456s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:05:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:05:47 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:05:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:47 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b Aug 26 19:05:47 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:52 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b" returned: 0 in 5.090s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:05:52 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Converted 1024.00 MB image at 201.14 MB/s Aug 26 19:05:52 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b is being set with open permissions: ugo+rw Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:52 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b Aug 26 19:05:52 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:52 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b" returned: 0 in 0.268s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-6068b378-6df6-4097-b4ef-4446960e512b" released by "_copy_volume_from_snapshot" :: held 6.479s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298-6068b378-6df6-4097-b4ef-4446960e512b" released by "_create_volume_from_snapshot" :: held 6.563s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.581s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.068s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Creating offline snapshot 44a48acb-8704-4926-9ae7-6db80f3e978a of volume b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b47b85-3d27-4d1d-8632-e26ddc2d83b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6068b378-6df6-4097-b4ef-4446960e512b', 'volume_size': 1, 'snapshot_id': 'ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8b7759-0d4b-4a8c-9c73-02df65375966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a7de20-f433-4847-8d07-7e220a8ee99a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:52 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Volume volume-6068b378-6df6-4097-b4ef-4446960e512b (6068b378-6df6-4097-b4ef-4446960e512b): created successfully Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8b7759-0d4b-4a8c-9c73-02df65375966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Flow 'volume_create_manager' (5157e602-d235-4fb1-ab5e-46fda2d26930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b101abcf-52c1-45b4-93ad-a807c1c8a4fd tempest-SnapshotDependencyTests-2069239439 None] Created volume successfully. Aug 26 19:05:52 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 Aug 26 19:05:52 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:52 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" returned: 0 in 0.402s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:53 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a 1G Aug 26 19:05:53 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:53 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a 1G" returned: 0 in 0.443s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:53 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a Aug 26 19:05:53 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "cinder-ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "cinder-quobyte-80d8586c-c718-44f1-ae7f-6a97e9812a73" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-80d8586c-c718-44f1-ae7f-6a97e9812a73" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "cinder-quobyte-ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Deleting offline snapshot ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 of volume 80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] snapshot_file for this snap is: volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4494bb4-15fa-4c2a-869c-edb83c95b122]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:53 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a" returned: 0 in 0.356s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:53 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a is being set with open permissions: ugo+rw Aug 26 19:05:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:53 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a Aug 26 19:05:53 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:53 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 Aug 26 19:05:53 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:54 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a" returned: 0 in 0.260s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:54 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.info Aug 26 19:05:54 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:54 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298" returned: 0 in 0.413s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d8586c-c718-44f1-ae7f-6a97e9812a73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c80325e-71c5-4092-8fe5-8ed288eb9ecc]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:54 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 Aug 26 19:05:54 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:54 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.info" returned: 0 in 0.275s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:54 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.info is being set with open permissions: ugo+rw Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:54 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.info Aug 26 19:05:54 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:54 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:54 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:54 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.info" returned: 0 in 0.279s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.420s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1bf19b-fe85-47f2-a714-a6ccc1a05fc8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:54 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-096ed4d1-6fbd-4111-84a0-1feeefb0d045 tempest-VolumeDependencyTests-1342370326 None] Create snapshot completed successfully Aug 26 19:05:54 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73" returned: 0 in 0.616s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:54 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.347s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:05:54 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 Aug 26 19:05:54 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:54 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b Aug 26 19:05:54 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:05:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:05:55 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b" returned: 0 in 0.460s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b921543-5aee-4cbd-a106-ffc328c4c979]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:55 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298" returned: 0 in 0.408s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:55 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298 Aug 26 19:05:55 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:55 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b Aug 26 19:05:55 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:55 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73.ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298" returned: 0 in 0.365s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298" released by "_delete_snapshot" :: held 1.938s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-80d8586c-c718-44f1-ae7f-6a97e9812a73" released by "delete_snapshot" :: held 1.968s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:05:55 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b" returned: 0 in 0.527s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.88d843bb-7b9c-4910-8446-e51d9188b2606uz95r91.img {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Flow 'volume_create_manager' (3e471ac3-3ef8-4678-a57e-165780658488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:05:55 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.88d843bb-7b9c-4910-8446-e51d9188b2606uz95r91.img Aug 26 19:05:55 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4090e577-1675-42bb-9250-e06231c61902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4090e577-1675-42bb-9250-e06231c61902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1620759780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337cfc72-5dc4-481d-a317-1f4cf1bd1e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67158e405ff4203a5d0d86002609f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44a48acb-8704-4926-9ae7-6db80f3e978a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:05:56Z,use_quota=True,user_id='9d5604513c244c8c9a3f6893c3282dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0196fdcb-f8f6-41c3-a6c6-c4283f65be33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0196fdcb-f8f6-41c3-a6c6-c4283f65be33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6d9003-9912-4c26-94cc-3056194cb9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6d9003-9912-4c26-94cc-3056194cb9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '337cfc72-5dc4-481d-a317-1f4cf1bd1e35', 'volume_name': 'volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35', 'volume_size': 1, 'snapshot_id': '44a48acb-8704-4926-9ae7-6db80f3e978a'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d4fdcd-df51-47c7-b8f2-574546823438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d4fdcd-df51-47c7-b8f2-574546823438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feaeeb28-0e96-4841-a364-30d7f6567100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:05:55 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Volume 337cfc72-5dc4-481d-a317-1f4cf1bd1e35: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35', 'volume_size': 1, 'snapshot_id': '44a48acb-8704-4926-9ae7-6db80f3e978a'} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Created reservations ['1c737093-1415-40d2-851a-5e7553ec3a41', '0967658a-56d0-430a-bf1a-371ce912cee0', '2e4e8d12-8919-4fea-ba30-851e9bd4cc35', '940fbe14-9cbf-4070-aa64-1c009edfda46'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Delete snapshot completed successfully. Aug 26 19:05:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-beee7a17-c977-42f0-8307-ec48630c1d74 tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-ffa1dd0f-1dfa-46c6-a0c0-850fedfa7298-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "cinder-80d8586c-c718-44f1-ae7f-6a97e9812a73-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-80d8586c-c718-44f1-ae7f-6a97e9812a73-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "cinder-quobyte-80d8586c-c718-44f1-ae7f-6a97e9812a73" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-80d8586c-c718-44f1-ae7f-6a97e9812a73" acquired by "delete_volume" :: waited 0.044s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:57 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32292fa-1f5f-4bfe-827d-90c4ac2b40d4]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:57 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 Aug 26 19:05:57 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:58 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73" returned: 0 in 0.905s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:58 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73 Aug 26 19:05:58 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:58 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=120,cinder:UPDATE=135,cinder:INSERT=38,cinder:DELETE=16 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:05:58 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Aug 26 19:05:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-80d8586c-c718-44f1-ae7f-6a97e9812a73" returned: 0 in 0.558s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:05:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-80d8586c-c718-44f1-ae7f-6a97e9812a73" released by "delete_volume" :: held 1.624s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:05:58 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=117,cinder:INSERT=39,cinder:UPDATE=154,cinder:DELETE=10 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Created reservations ['aa648c63-6b5c-43a8-bc71-d4861f26469b', 'baf42499-8e9d-4281-aabd-91bb1005a0c7', 'e5629225-5b14-417e-ad2a-bbed754e93cd', 'b8c5ed97-4165-4ccc-951a-d6b698228d73'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:05:59 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:05:59 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "cinder-6068b378-6df6-4097-b4ef-4446960e512b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-6068b378-6df6-4097-b4ef-4446960e512b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "cinder-quobyte-6068b378-6df6-4097-b4ef-4446960e512b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-6068b378-6df6-4097-b4ef-4446960e512b" acquired by "delete_volume" :: waited 0.039s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacbf067-10fa-4e52-a46c-2d625746180f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:05:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:00 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.717s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:06:00 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Deleted volume successfully. Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-410b1145-d30a-44fd-bc86-d1832216f6ab tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-80d8586c-c718-44f1-ae7f-6a97e9812a73-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:00 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b Aug 26 19:06:00 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:00 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b" returned: 0 in 0.752s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:00 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.88d843bb-7b9c-4910-8446-e51d9188b2606uz95r91.img" returned: 0 in 4.887s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:00 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b Aug 26 19:06:00 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[88685b90-da2b-4429-8bdc-5980c8013854]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:00 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b Aug 26 19:06:00 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:00 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6068b378-6df6-4097-b4ef-4446960e512b" returned: 0 in 0.275s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-quobyte-6068b378-6df6-4097-b4ef-4446960e512b" released by "delete_volume" :: held 1.107s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:00 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Created reservations ['bf0320e9-07a6-4dbd-8047-1e87378c87e0', 'd7cc10df-5ddd-4a56-b507-d21caf199bb9', '037f72ae-6b85-4860-b998-10daba613355', '5f9872f5-67e9-4e0b-8742-9bf12a87bd64'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:01 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:06:01 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:01 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b" returned: 0 in 0.544s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.88d843bb-7b9c-4910-8446-e51d9188b2606uz95r91.img {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:06:01 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Converted 1024.00 MB image at 209.46 MB/s Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] 88d843bb-7b9c-4910-8446-e51d9188b260 was raw, no need to convert to raw {{(pid=93671) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 19:06:01 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.263s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:06:01 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Deleted volume successfully. Aug 26 19:06:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9f47e140-b562-4451-8d48-3d155579361e tempest-SnapshotDependencyTests-2069239439 None] Lock "cinder-6068b378-6df6-4097-b4ef-4446960e512b-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:10 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=8,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:06:11 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=14,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.735s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Uploaded volume to glance image-id: 88d843bb-7b9c-4910-8446-e51d9188b260. {{(pid=93671) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 25.557s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "cinder-quobyte-44a48acb-8704-4926-9ae7-6db80f3e978a-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" by "_create_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-44a48acb-8704-4926-9ae7-6db80f3e978a-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Creating volume 337cfc72-5dc4-481d-a317-1f4cf1bd1e35 from snapshot 44a48acb-8704-4926-9ae7-6db80f3e978a {{(pid=93671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "cinder-quobyte-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8a6168fd-d0b4-4b24-b950-51c1738ff7b1 tempest-VolumesActionsTest-1548357733 None] Copy volume to image completed successfully. Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] snapshot: 44a48acb-8704-4926-9ae7-6db80f3e978a, volume: 337cfc72-5dc4-481d-a317-1f4cf1bd1e35, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ffbc0f-c84e-4a32-a57a-0e35ef3aae59]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:21 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a Aug 26 19:06:21 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:21 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a" returned: 0 in 0.357s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2726dd-6885-4c8f-84be-df849a880488]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:21 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 Aug 26 19:06:21 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:22 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:06:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:06:22 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:06:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:22 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 Aug 26 19:06:22 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:26 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" returned: 0 in 4.212s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:06:26 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Converted 1024.00 MB image at 243.04 MB/s Aug 26 19:06:26 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 is being set with open permissions: ugo+rw Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:26 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 Aug 26 19:06:26 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:26 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" returned: 0 in 0.234s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" released by "_copy_volume_from_snapshot" :: held 5.262s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-44a48acb-8704-4926-9ae7-6db80f3e978a-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" released by "_create_volume_from_snapshot" :: held 5.325s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.346s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.984s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d810de35-2fc3-4f2d-a187-549371ee3b0f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feaeeb28-0e96-4841-a364-30d7f6567100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35', 'volume_size': 1, 'snapshot_id': '44a48acb-8704-4926-9ae7-6db80f3e978a'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3f5ae0-d6a4-4502-916b-260fae87f585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:26 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Volume volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 (337cfc72-5dc4-481d-a317-1f4cf1bd1e35): created successfully Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3f5ae0-d6a4-4502-916b-260fae87f585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Flow 'volume_create_manager' (3e471ac3-3ef8-4678-a57e-165780658488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7d606234-0708-4a9c-a9da-b141f18b259b tempest-VolumeDependencyTests-1342370326 None] Created volume successfully. Aug 26 19:06:26 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b Aug 26 19:06:26 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:27 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b" returned: 0 in 0.353s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88b064-c5c7-42cb-8321-728155dec0c9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:27 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b Aug 26 19:06:27 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "cinder-44a48acb-8704-4926-9ae7-6db80f3e978a-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-44a48acb-8704-4926-9ae7-6db80f3e978a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "cinder-quobyte-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "cinder-quobyte-44a48acb-8704-4926-9ae7-6db80f3e978a" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-44a48acb-8704-4926-9ae7-6db80f3e978a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Deleting offline snapshot 44a48acb-8704-4926-9ae7-6db80f3e978a of volume b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] snapshot_file for this snap is: volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eef75d-2532-4911-8061-cfd660f070ca]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:27 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a Aug 26 19:06:27 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:27 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b" returned: 0 in 0.374s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:27 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img Aug 26 19:06:27 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:27 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a" returned: 0 in 0.367s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece4f63-a108-42ad-9eb7-7dfccfa249d6]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:27 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 Aug 26 19:06:27 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:28 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" returned: 0 in 0.921s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:28 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a Aug 26 19:06:28 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:29 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a" returned: 0 in 0.829s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:29 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a Aug 26 19:06:29 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:30 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8.44a48acb-8704-4926-9ae7-6db80f3e978a" returned: 0 in 0.614s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-44a48acb-8704-4926-9ae7-6db80f3e978a" released by "_delete_snapshot" :: held 2.919s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" released by "delete_snapshot" :: held 2.955s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:30 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Created reservations ['0088638f-d828-4cfc-b1a9-3a89bd1a52e0', 'de6832cf-cde4-4ea1-949c-05d78856796e', 'b82ed815-15d7-471e-baff-bb301d70d112', '0083b5ad-1fc7-46c1-b8e6-2e6c4160f72b'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:06:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Delete snapshot completed successfully. Aug 26 19:06:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d800eb97-fe13-4a00-b245-2d1d3ccc5ee5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-44a48acb-8704-4926-9ae7-6db80f3e978a-delete_snapshot" released by "delete_snapshot" :: held 3.263s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "cinder-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "cinder-quobyte-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" acquired by "delete_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:31 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9260d86d-fd67-4e0a-8649-45bc324d28cb]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:31 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 Aug 26 19:06:31 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:31 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" returned: 0 in 0.780s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:31 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8 Aug 26 19:06:31 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:32 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img" returned: 0 in 4.513s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8566b1e-b0dd-44c2-a657-f1f8b595ba72]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:32 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b Aug 26 19:06:32 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:32 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" returned: 0 in 0.356s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8" released by "delete_volume" :: held 1.258s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Created reservations ['599d7bc3-a1fc-4475-b266-5c5b7c869015', 'd93bb574-390b-424f-a830-71d9f16db733', '43f048d5-094a-4e50-91ff-92a8d8aca508', 'd8474044-ee7c-4987-bbcf-1d5b691a0f91'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:32 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:06:32 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:32 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.259s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:06:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Deleted volume successfully. Aug 26 19:06:32 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b" returned: 0 in 0.559s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:06:32 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Converted 1024.00 MB image at 226.85 MB/s Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] 30a05f73-df2e-492b-bd44-1ef1134431d2 was raw, converting to qcow2 {{(pid=93671) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b4af7400-ccb3-45a4-a10f-3317d74fc8be tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-b0cfc744-1ce8-4e81-95f6-6a0e30c7b0b8-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0821e9e4-081b-449e-802b-0c60906025e3]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:32 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img Aug 26 19:06:32 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:32 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img" returned: 0 in 0.321s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:33 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img Aug 26 19:06:33 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "cinder-337cfc72-5dc4-481d-a317-1f4cf1bd1e35-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-337cfc72-5dc4-481d-a317-1f4cf1bd1e35-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "cinder-quobyte-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5aabf6-c293-43f9-9928-624908de8d34]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:33 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img" returned: 1 in 0.357s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img /opt/stack/data/cinder/conversion/vol_upload_5y6pf74n {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:33 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img /opt/stack/data/cinder/conversion/vol_upload_5y6pf74n Aug 26 19:06:33 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:33 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 Aug 26 19:06:33 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:33 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img /opt/stack/data/cinder/conversion/vol_upload_5y6pf74n" returned: 0 in 0.275s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Image conversion details: src /opt/stack/data/cinder/conversion/b11406a2-13d4-4b46-bb40-a04ab9ab673b.temp_image.30a05f73-df2e-492b-bd44-1ef1134431d2z7kmixat.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5y6pf74n {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:06:33 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebdb4ab-5340-4561-b315-2c8fad1ac66e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5y6pf74n {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:33 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" returned: 0 in 0.395s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:33 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35 Aug 26 19:06:33 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:33 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5y6pf74n Aug 26 19:06:33 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:33 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-quobyte-337cfc72-5dc4-481d-a317-1f4cf1bd1e35" released by "delete_volume" :: held 0.725s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:33 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5y6pf74n" returned: 0 in 0.362s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Created reservations ['14445c38-2c36-41c9-aff0-4f66f2b7b25a', 'ac704cab-c3f1-44fe-95f2-7fe8940e9e9e', '85fa5215-ad03-4064-b39f-b83e3a228185', '8941724c-a666-4f06-8940-18ecff6184c1'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:34 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:06:34 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:34 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.292s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:06:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Deleted volume successfully. Aug 26 19:06:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7e54f531-fbc3-4331-a3dc-0872b115b4a5 tempest-VolumeDependencyTests-1342370326 None] Lock "cinder-337cfc72-5dc4-481d-a317-1f4cf1bd1e35-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.807s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Uploaded volume to glance image-id: 30a05f73-df2e-492b-bd44-1ef1134431d2. {{(pid=93671) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 19:06:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4d5c4c50-7110-46d9-99a1-48e5d57a2cd1 tempest-VolumesActionsTest-1548357733 None] Copy volume to image completed successfully. Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Acquiring lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Acquiring lock "cinder-quobyte-b11406a2-13d4-4b46-bb40-a04ab9ab673b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Lock "cinder-quobyte-b11406a2-13d4-4b46-bb40-a04ab9ab673b" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea5b29a-775d-42cc-9e1b-7c8faa3d6083]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:37 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b Aug 26 19:06:37 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Flow 'volume_create_manager' (80fe9923-a85b-40ad-b13b-dd68b2cdb6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6be63a-8e80-4053-be3d-cf26b00ceee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6be63a-8e80-4053-be3d-cf26b00ceee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa29341-1042-48d6-a83b-dac2c6dbdd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f53146654f47f0bf158bb18440ac72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:37Z,use_quota=True,user_id='37ce33af406a41f3a1724599174bb6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980e85ab-aeda-4de2-b12a-841ac9937b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980e85ab-aeda-4de2-b12a-841ac9937b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba19b74d-994a-4056-b162-796004c33193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba19b74d-994a-4056-b162-796004c33193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa29341-1042-48d6-a83b-dac2c6dbdd13', 'volume_name': 'volume-daa29341-1042-48d6-a83b-dac2c6dbdd13', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaee1888-7791-4ece-8924-4a9cb3d00198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaee1888-7791-4ece-8924-4a9cb3d00198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c5589a-990a-4e86-b96e-191034c0263d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:37 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Volume daa29341-1042-48d6-a83b-dac2c6dbdd13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa29341-1042-48d6-a83b-dac2c6dbdd13', 'volume_size': 1} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa29341-1042-48d6-a83b-dac2c6dbdd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f53146654f47f0bf158bb18440ac72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:37Z,use_quota=True,user_id='37ce33af406a41f3a1724599174bb6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Creating volume daa29341-1042-48d6-a83b-dac2c6dbdd13 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:06:37 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:37 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 1073741824 Aug 26 19:06:37 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:37 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:37 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b Aug 26 19:06:37 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:38 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b11406a2-13d4-4b46-bb40-a04ab9ab673b" returned: 0 in 0.247s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Lock "cinder-quobyte-b11406a2-13d4-4b46-bb40-a04ab9ab673b" released by "delete_volume" :: held 0.664s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:38 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 1073741824" returned: 0 in 0.442s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Created reservations ['2b3f11a8-92e8-4115-a669-d0e0c53995b9', 'b0610bf5-d053-40a2-bfed-3d82271db7d4', 'dd97be27-873b-406f-8c5c-2c7dc1cd4f19', '5c9b5e23-07d7-47b2-9447-25e6ccf59151'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:38 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 Aug 26 19:06:38 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:38 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:06:38 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:38 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13" returned: 0 in 0.268s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c5589a-990a-4e86-b96e-191034c0263d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa29341-1042-48d6-a83b-dac2c6dbdd13', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8cc5b7-5aa8-41ee-89b3-fe4784e06931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:38 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Volume volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 (daa29341-1042-48d6-a83b-dac2c6dbdd13): created successfully Aug 26 19:06:38 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8cc5b7-5aa8-41ee-89b3-fe4784e06931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Flow 'volume_create_manager' (80fe9923-a85b-40ad-b13b-dd68b2cdb6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.270s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:06:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Deleted volume successfully. Aug 26 19:06:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d870e9fb-a39b-44d0-ab04-d2c8faa853c3 tempest-CinderUnicodeTest-129520264 None] Created volume successfully. Aug 26 19:06:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d28f59bb-74e2-4aa3-b125-55e036a648d5 tempest-VolumesActionsTest-1548357733 None] Lock "cinder-b11406a2-13d4-4b46-bb40-a04ab9ab673b-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Flow 'volume_create_manager' (0ad489ef-b951-40b5-b9d3-8693c256da7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b991d9-389d-462f-9d03-40014dd38037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b991d9-389d-462f-9d03-40014dd38037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1893956766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0318c291-caca-4af8-a38e-ebb183479f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f53146654f47f0bf158bb18440ac72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:39Z,use_quota=True,user_id='37ce33af406a41f3a1724599174bb6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d59be5-0f84-46f5-bf7a-b0b9936bcef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d59be5-0f84-46f5-bf7a-b0b9936bcef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0681cf-1bd7-476a-a366-c2a1ad3dc681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0681cf-1bd7-476a-a366-c2a1ad3dc681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0318c291-caca-4af8-a38e-ebb183479f35', 'volume_name': 'volume-0318c291-caca-4af8-a38e-ebb183479f35', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b813ac6f-adc7-4811-860b-965dec25e369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b813ac6f-adc7-4811-860b-965dec25e369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f579ba2f-4c52-49e7-95b2-db6b55169cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:39 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Volume 0318c291-caca-4af8-a38e-ebb183479f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0318c291-caca-4af8-a38e-ebb183479f35', 'volume_size': 1} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1893956766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0318c291-caca-4af8-a38e-ebb183479f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f53146654f47f0bf158bb18440ac72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:39Z,use_quota=True,user_id='37ce33af406a41f3a1724599174bb6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Creating volume 0318c291-caca-4af8-a38e-ebb183479f35 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:06:39 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:39 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 1073741824 Aug 26 19:06:39 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:39 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 1073741824" returned: 0 in 0.492s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:39 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 Aug 26 19:06:39 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:40 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35" returned: 0 in 0.303s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:06:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f579ba2f-4c52-49e7-95b2-db6b55169cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0318c291-caca-4af8-a38e-ebb183479f35', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1765bc53-9779-44a8-9df1-989f01e1ce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:40 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Volume volume-0318c291-caca-4af8-a38e-ebb183479f35 (0318c291-caca-4af8-a38e-ebb183479f35): created successfully Aug 26 19:06:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1765bc53-9779-44a8-9df1-989f01e1ce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Flow 'volume_create_manager' (0ad489ef-b951-40b5-b9d3-8693c256da7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ec44a406-0080-4362-9426-ee3e7004ab50 tempest-CinderUnicodeTest-129520264 None] Created volume successfully. Aug 26 19:06:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Creating offline snapshot f8f555a2-3602-4078-84e6-22b2ef205d85 of volume 0318c291-caca-4af8-a38e-ebb183479f35 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:06:41 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e545cf-2e82-4bf3-9ccf-a8e8242506e9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:41 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 Aug 26 19:06:41 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:42 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35" returned: 0 in 0.429s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:42 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 1G Aug 26 19:06:42 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:42 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 1G" returned: 0 in 0.463s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0318c291-caca-4af8-a38e-ebb183479f35 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:42 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0318c291-caca-4af8-a38e-ebb183479f35 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 Aug 26 19:06:42 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:42 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0318c291-caca-4af8-a38e-ebb183479f35 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85" returned: 0 in 0.352s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:42 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 is being set with open permissions: ugo+rw Aug 26 19:06:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:42 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 Aug 26 19:06:42 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:43 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85" returned: 0 in 0.257s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:43 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.info Aug 26 19:06:43 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:43 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.info" returned: 0 in 0.270s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:43 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.info is being set with open permissions: ugo+rw Aug 26 19:06:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:43 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.info Aug 26 19:06:43 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:43 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.info" returned: 0 in 0.310s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:43 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9c41d842-4b4f-48cc-969a-d893a0d5d3f9 tempest-CinderUnicodeTest-129520264 None] Create snapshot completed successfully Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "cinder-f8f555a2-3602-4078-84e6-22b2ef205d85-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-f8f555a2-3602-4078-84e6-22b2ef205d85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "cinder-quobyte-0318c291-caca-4af8-a38e-ebb183479f35" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-quobyte-0318c291-caca-4af8-a38e-ebb183479f35" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "cinder-quobyte-f8f555a2-3602-4078-84e6-22b2ef205d85" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-quobyte-f8f555a2-3602-4078-84e6-22b2ef205d85" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Deleting offline snapshot f8f555a2-3602-4078-84e6-22b2ef205d85 of volume 0318c291-caca-4af8-a38e-ebb183479f35 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] snapshot_file for this snap is: volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[15481cc5-e4ad-4b95-99bb-ba18f6a23ea4]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:45 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 Aug 26 19:06:45 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:45 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85" returned: 0 in 0.420s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0318c291-caca-4af8-a38e-ebb183479f35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:06:45 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5497a071-780a-4d0b-913e-653dbc7a4005]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:45 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 Aug 26 19:06:45 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:45 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35" returned: 0 in 0.397s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:45 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 Aug 26 19:06:45 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:46 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85" returned: 0 in 0.379s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:46 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85 Aug 26 19:06:46 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:46 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35.f8f555a2-3602-4078-84e6-22b2ef205d85" returned: 0 in 0.257s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-quobyte-f8f555a2-3602-4078-84e6-22b2ef205d85" released by "_delete_snapshot" :: held 1.568s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-quobyte-0318c291-caca-4af8-a38e-ebb183479f35" released by "delete_snapshot" :: held 1.592s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:46 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Created reservations ['c5838960-1d34-40d4-87ef-7cea110e945e', 'bfb25b7a-9e38-4ab8-a035-f7c638937a33', '5a8cebc9-7df2-499e-93fa-4e155cd602cd', '7a90381b-1726-4d35-bb0f-c5d77434cc84'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:06:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Delete snapshot completed successfully. Aug 26 19:06:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-dce62c0e-d984-47f9-8a0b-b61146df8600 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-f8f555a2-3602-4078-84e6-22b2ef205d85-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Acquiring lock "cinder-0318c291-caca-4af8-a38e-ebb183479f35-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Lock "cinder-0318c291-caca-4af8-a38e-ebb183479f35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Acquiring lock "cinder-quobyte-0318c291-caca-4af8-a38e-ebb183479f35" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Lock "cinder-quobyte-0318c291-caca-4af8-a38e-ebb183479f35" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1722d9-a82e-4d91-9963-e5301947da30]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:47 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 Aug 26 19:06:47 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:47 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35" returned: 0 in 0.399s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:47 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35 Aug 26 19:06:47 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:47 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0318c291-caca-4af8-a38e-ebb183479f35" returned: 0 in 0.264s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Lock "cinder-quobyte-0318c291-caca-4af8-a38e-ebb183479f35" released by "delete_volume" :: held 0.730s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Flow 'volume_create_manager' (4390df3c-d0a3-4d78-b6fb-2832a6821ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c700ef-2911-4370-b386-0e10e220e884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c700ef-2911-4370-b386-0e10e220e884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1023285897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e7ccb6-71a2-4a1f-8566-10a2e990f5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37403440bcc449639492a5c266cfdead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:48Z,use_quota=True,user_id='697302a1f9324f8984a32d57c0e857b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89af1edc-764d-4398-96da-bc7e7e5e5984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89af1edc-764d-4398-96da-bc7e7e5e5984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68fd617-6d1a-4a2e-8db2-32ad65239888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68fd617-6d1a-4a2e-8db2-32ad65239888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e7ccb6-71a2-4a1f-8566-10a2e990f5c7', 'volume_name': 'volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d56a90-ae46-4fd6-8541-d38920c311a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d56a90-ae46-4fd6-8541-d38920c311a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f911786d-0f42-46ac-9b6f-b0d93ff93eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:47 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Volume 09e7ccb6-71a2-4a1f-8566-10a2e990f5c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7', 'volume_size': 1} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1023285897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e7ccb6-71a2-4a1f-8566-10a2e990f5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37403440bcc449639492a5c266cfdead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:48Z,use_quota=True,user_id='697302a1f9324f8984a32d57c0e857b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Creating volume 09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:06:47 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:06:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:47 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 1073741824 Aug 26 19:06:47 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Created reservations ['13aa7ae6-4836-4906-af31-8caa9f745ef1', '4ba5030a-83e6-4071-9812-6cf42ec83167', '87d02e6d-467c-4127-8be7-779bc5914f67', '7471d3dc-1c90-4acd-8972-c21f91c8926f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:48 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:06:48 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "cinder-daa29341-1042-48d6-a83b-dac2c6dbdd13-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-daa29341-1042-48d6-a83b-dac2c6dbdd13-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "cinder-quobyte-daa29341-1042-48d6-a83b-dac2c6dbdd13" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-quobyte-daa29341-1042-48d6-a83b-dac2c6dbdd13" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:48 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.261s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:06:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Deleted volume successfully. Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85b608f-e321-4814-9360-72fcee5190b3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-517f0eb0-943e-4be0-b3fb-c21b40a4173d tempest-CinderUnicodeTest-129520264 None] Lock "cinder-0318c291-caca-4af8-a38e-ebb183479f35-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:48 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 1073741824" returned: 0 in 0.496s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:48 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 Aug 26 19:06:48 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:48 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 Aug 26 19:06:48 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:48 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13" returned: 0 in 0.405s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:48 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13 Aug 26 19:06:48 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:48 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f911786d-0f42-46ac-9b6f-b0d93ff93eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abacdff5-edf6-42f9-826d-beeed15bb58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:48 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Volume volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 (09e7ccb6-71a2-4a1f-8566-10a2e990f5c7): created successfully Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abacdff5-edf6-42f9-826d-beeed15bb58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Flow 'volume_create_manager' (4390df3c-d0a3-4d78-b6fb-2832a6821ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3cb1ccb8-305d-4639-b678-3c601f1bcb9b tempest-VolumesNegativeTest-569508466 None] Created volume successfully. Aug 26 19:06:49 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-daa29341-1042-48d6-a83b-dac2c6dbdd13" returned: 0 in 0.270s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-quobyte-daa29341-1042-48d6-a83b-dac2c6dbdd13" released by "delete_volume" :: held 0.715s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Created reservations ['1a16bc83-c9d7-40d6-bd48-2a5940032d43', '6da261f9-f702-4e9e-ac6a-5ba99dc5ddc2', '6883ff8f-7b4a-4c43-b2fb-667e2e800a22', '053b92cd-aad7-411a-80e5-9aa73fdc62aa'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:49 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:06:49 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:49 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.251s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:06:49 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Deleted volume successfully. Aug 26 19:06:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7bf2c722-f288-4924-a258-f75cda901dc5 tempest-CinderUnicodeTest-129520264 None] Lock "cinder-daa29341-1042-48d6-a83b-dac2c6dbdd13-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Flow 'volume_create_manager' (c8d5c1ea-d688-47f6-b83e-04c608eeb2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3646a066-3d20-4ecb-8bc8-50ac2c9b57c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3646a066-3d20-4ecb-8bc8-50ac2c9b57c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977145796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbde462-e543-4bc2-a497-1564ad046fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bdc3525d374151ad0d97f6545fe6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:54Z,use_quota=True,user_id='8e1a25652dbb4ec8815bef8763a91799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcd0d4-8045-4b3f-aef6-d8fbe00380b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcd0d4-8045-4b3f-aef6-d8fbe00380b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d99ece-efa3-4907-a9b7-dc4b48108205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d99ece-efa3-4907-a9b7-dc4b48108205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbde462-e543-4bc2-a497-1564ad046fd4', 'volume_name': 'volume-dbbde462-e543-4bc2-a497-1564ad046fd4', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab84c65-eb7a-40cc-b731-f00b5e69a5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab84c65-eb7a-40cc-b731-f00b5e69a5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7f2cf6-0e96-45ee-81e1-31b280a0d639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:53 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Volume dbbde462-e543-4bc2-a497-1564ad046fd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbde462-e543-4bc2-a497-1564ad046fd4', 'volume_size': 1} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1977145796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbde462-e543-4bc2-a497-1564ad046fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bdc3525d374151ad0d97f6545fe6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:54Z,use_quota=True,user_id='8e1a25652dbb4ec8815bef8763a91799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Creating volume dbbde462-e543-4bc2-a497-1564ad046fd4 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:06:53 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:06:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:53 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4 1073741824 Aug 26 19:06:53 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:54 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4 1073741824" returned: 0 in 0.483s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:54 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4 Aug 26 19:06:54 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:54 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4" returned: 0 in 0.293s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:54 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:06:54 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7f2cf6-0e96-45ee-81e1-31b280a0d639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbde462-e543-4bc2-a497-1564ad046fd4', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9bc42e-8332-4861-ad1c-81b1f97c646c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:54 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Volume volume-dbbde462-e543-4bc2-a497-1564ad046fd4 (dbbde462-e543-4bc2-a497-1564ad046fd4): created successfully Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9bc42e-8332-4861-ad1c-81b1f97c646c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Flow 'volume_create_manager' (c8d5c1ea-d688-47f6-b83e-04c608eeb2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:54 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-97d57adf-cac7-40b5-b4d1-8c70f555da3d tempest-ProjectReaderTests-412745454 None] Created volume successfully. Aug 26 19:06:54 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.299s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:06:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:06:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Acquiring lock "cinder-dbbde462-e543-4bc2-a497-1564ad046fd4-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Lock "cinder-dbbde462-e543-4bc2-a497-1564ad046fd4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Acquiring lock "cinder-quobyte-dbbde462-e543-4bc2-a497-1564ad046fd4" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Lock "cinder-quobyte-dbbde462-e543-4bc2-a497-1564ad046fd4" acquired by "delete_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:56 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e63e32-ba03-4269-bb3c-5c4bf1e1271b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:06:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:56 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4 Aug 26 19:06:56 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:56 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4" returned: 0 in 0.458s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:56 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4 Aug 26 19:06:56 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:56 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbbde462-e543-4bc2-a497-1564ad046fd4" returned: 0 in 0.291s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Lock "cinder-quobyte-dbbde462-e543-4bc2-a497-1564ad046fd4" released by "delete_volume" :: held 0.829s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Created reservations ['fadd6b84-60ab-49a3-bacd-5a11240003a7', '336457f0-66fc-4c3f-a368-b8da0e2ae854', 'b651206a-285a-436b-9947-b11aba2587bd', '70047b18-2016-4c44-84f3-8e69af24d330'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:57 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:06:57 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:57 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.257s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:06:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Deleted volume successfully. Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a4db1e76-3b56-4275-aff7-4307351c5758 tempest-ProjectReaderTests-412745454 None] Lock "cinder-dbbde462-e543-4bc2-a497-1564ad046fd4-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Flow 'volume_create_manager' (26d7e594-5901-4742-9627-3db6476d8add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c481a3f-85e6-4a43-be64-80ed0d3e8fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c481a3f-85e6-4a43-be64-80ed0d3e8fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-642386696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d8fd76-58d0-4a6d-9d48-25b4e83cc565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bdc3525d374151ad0d97f6545fe6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:58Z,use_quota=True,user_id='8e1a25652dbb4ec8815bef8763a91799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e1de9b-3cf2-4aed-9e60-6a566e03e6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e1de9b-3cf2-4aed-9e60-6a566e03e6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9718fea1-8b98-4289-a2ac-e39f4cce0a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9718fea1-8b98-4289-a2ac-e39f4cce0a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d8fd76-58d0-4a6d-9d48-25b4e83cc565', 'volume_name': 'volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6563e7-df94-4163-b443-11e4c5aad73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6563e7-df94-4163-b443-11e4c5aad73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70179586-ae1e-4349-b4b7-ae775c2d0cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:57 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Volume a3d8fd76-58d0-4a6d-9d48-25b4e83cc565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565', 'volume_size': 1} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-642386696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d8fd76-58d0-4a6d-9d48-25b4e83cc565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bdc3525d374151ad0d97f6545fe6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:06:58Z,use_quota=True,user_id='8e1a25652dbb4ec8815bef8763a91799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Creating volume a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:06:57 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:06:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:57 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 1073741824 Aug 26 19:06:57 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:58 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 1073741824" returned: 0 in 0.534s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:06:58 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 Aug 26 19:06:58 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:06:58 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Aug 26 19:06:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565" returned: 0 in 0.339s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:06:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:06:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:06:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70179586-ae1e-4349-b4b7-ae775c2d0cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a07bfa4-0468-46eb-8ab3-e3c18c16cdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:06:58 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Volume volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 (a3d8fd76-58d0-4a6d-9d48-25b4e83cc565): created successfully Aug 26 19:06:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a07bfa4-0468-46eb-8ab3-e3c18c16cdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:06:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Flow 'volume_create_manager' (26d7e594-5901-4742-9627-3db6476d8add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:06:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a7d169a8-2258-4db0-a4c4-cc075f2567ba tempest-ProjectReaderTests-412745454 None] Created volume successfully. Aug 26 19:06:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Acquiring lock "cinder-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Lock "cinder-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:06:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Acquiring lock "cinder-quobyte-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:06:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Lock "cinder-quobyte-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565" acquired by "delete_volume" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d3447a-4de8-40c6-b6b0-afe0941d43d8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:00 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 Aug 26 19:07:00 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:00 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565" returned: 0 in 0.453s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:00 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565 Aug 26 19:07:00 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:00 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565" returned: 0 in 0.255s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Lock "cinder-quobyte-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565" released by "delete_volume" :: held 0.775s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Created reservations ['1b72ad87-3885-4c57-a10a-16e665eaf494', 'c6bdb6ac-2845-456d-930c-c7eff00526a5', '12b4a104-0430-4a21-8df8-d59198286184', '7b0f1b98-1287-4a8d-8feb-bf1073f4d6d3'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:01 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:01 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:01 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.256s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:01 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Deleted volume successfully. Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6e6c24f-8ab5-44b3-8d71-df4b9a1b7989 tempest-ProjectReaderTests-412745454 None] Lock "cinder-a3d8fd76-58d0-4a6d-9d48-25b4e83cc565-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Flow 'volume_create_manager' (fa7f3261-c490-49f1-aefc-73342149891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2297bd8a-c1f8-472f-b863-f1f2041976f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2297bd8a-c1f8-472f-b863-f1f2041976f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1342433623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b02992-d36a-4560-a7ff-ac33224bb283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bdc3525d374151ad0d97f6545fe6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:02Z,use_quota=True,user_id='8e1a25652dbb4ec8815bef8763a91799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bea853-c041-4664-9cc5-8c13a7e17d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bea853-c041-4664-9cc5-8c13a7e17d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb77cfb5-a635-4545-9375-f4a94fb84100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb77cfb5-a635-4545-9375-f4a94fb84100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b02992-d36a-4560-a7ff-ac33224bb283', 'volume_name': 'volume-31b02992-d36a-4560-a7ff-ac33224bb283', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5caa952-bb09-4c2a-bb16-075c29855f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5caa952-bb09-4c2a-bb16-075c29855f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dacb125-2a2d-409a-a522-aa7efa307411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:01 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Volume 31b02992-d36a-4560-a7ff-ac33224bb283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b02992-d36a-4560-a7ff-ac33224bb283', 'volume_size': 1} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1342433623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b02992-d36a-4560-a7ff-ac33224bb283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bdc3525d374151ad0d97f6545fe6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:02Z,use_quota=True,user_id='8e1a25652dbb4ec8815bef8763a91799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Creating volume 31b02992-d36a-4560-a7ff-ac33224bb283 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:07:01 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:07:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:01 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283 1073741824 Aug 26 19:07:01 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:02 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283 1073741824" returned: 0 in 0.428s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:02 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283 Aug 26 19:07:02 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:02 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283" returned: 0 in 0.252s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dacb125-2a2d-409a-a522-aa7efa307411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b02992-d36a-4560-a7ff-ac33224bb283', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771e3101-0281-4270-9424-adc83fafc830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:02 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Volume volume-31b02992-d36a-4560-a7ff-ac33224bb283 (31b02992-d36a-4560-a7ff-ac33224bb283): created successfully Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771e3101-0281-4270-9424-adc83fafc830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Flow 'volume_create_manager' (fa7f3261-c490-49f1-aefc-73342149891a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:02 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-77a7db62-0fef-4eec-8dd3-815b0123db16 tempest-ProjectReaderTests-412745454 None] Created volume successfully. Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Acquiring lock "cinder-31b02992-d36a-4560-a7ff-ac33224bb283-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Lock "cinder-31b02992-d36a-4560-a7ff-ac33224bb283-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Acquiring lock "cinder-quobyte-31b02992-d36a-4560-a7ff-ac33224bb283" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Lock "cinder-quobyte-31b02992-d36a-4560-a7ff-ac33224bb283" acquired by "delete_volume" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[df10599e-038b-44f6-8780-2b44308fc487]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:02 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283 Aug 26 19:07:02 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:03 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283" returned: 0 in 0.370s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:03 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283 Aug 26 19:07:03 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:03 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-31b02992-d36a-4560-a7ff-ac33224bb283" returned: 0 in 0.269s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Lock "cinder-quobyte-31b02992-d36a-4560-a7ff-ac33224bb283" released by "delete_volume" :: held 0.682s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Created reservations ['ee4d2643-8866-4f2a-b6fb-ce58de095474', '08e09f6f-14e4-4615-a6cf-d8742ef78a54', 'e608fc36-fdde-45d6-8bf6-00127b882905', 'c0210d39-ab0b-45e3-880e-dc9cbbc6c035'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:03 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:03 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:03 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.319s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Deleted volume successfully. Aug 26 19:07:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e7ca6d1-f153-4781-9da7-9fe7e5335a79 tempest-ProjectReaderTests-412745454 None] Lock "cinder-31b02992-d36a-4560-a7ff-ac33224bb283-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Flow 'volume_create_manager' (6a61544e-9345-4f6c-afe9-ad96981f06ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe179272-a4b8-4143-b4c9-3eac7ddb5822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe179272-a4b8-4143-b4c9-3eac7ddb5822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736594135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd518e6-bbc9-463b-a04d-5d582d94a865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bdc3525d374151ad0d97f6545fe6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:04Z,use_quota=True,user_id='8e1a25652dbb4ec8815bef8763a91799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f7c206-581d-4616-8a54-a3c59636ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f7c206-581d-4616-8a54-a3c59636ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619d93ba-751d-4e6a-a3d5-36961f575d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619d93ba-751d-4e6a-a3d5-36961f575d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd518e6-bbc9-463b-a04d-5d582d94a865', 'volume_name': 'volume-1cd518e6-bbc9-463b-a04d-5d582d94a865', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7c7bea-5ec4-46cb-aa1c-943ada962e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f7c7bea-5ec4-46cb-aa1c-943ada962e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f058fe-5e9b-437d-aff4-41387c41de5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:04 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Volume 1cd518e6-bbc9-463b-a04d-5d582d94a865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd518e6-bbc9-463b-a04d-5d582d94a865', 'volume_size': 1} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736594135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd518e6-bbc9-463b-a04d-5d582d94a865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bdc3525d374151ad0d97f6545fe6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:04Z,use_quota=True,user_id='8e1a25652dbb4ec8815bef8763a91799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Creating volume 1cd518e6-bbc9-463b-a04d-5d582d94a865 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:07:04 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:04 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 1073741824 Aug 26 19:07:04 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:04 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 1073741824" returned: 0 in 0.451s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:05 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 Aug 26 19:07:05 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:05 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865" returned: 0 in 0.260s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:07:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f058fe-5e9b-437d-aff4-41387c41de5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd518e6-bbc9-463b-a04d-5d582d94a865', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba304ebb-afe9-46ff-87f5-eafe7f71d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:05 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Volume volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 (1cd518e6-bbc9-463b-a04d-5d582d94a865): created successfully Aug 26 19:07:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba304ebb-afe9-46ff-87f5-eafe7f71d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Flow 'volume_create_manager' (6a61544e-9345-4f6c-afe9-ad96981f06ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:05 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e27e5d7e-b49c-4cd4-9276-143139131276 tempest-ProjectReaderTests-412745454 None] Created volume successfully. Aug 26 19:07:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Acquiring lock "cinder-1cd518e6-bbc9-463b-a04d-5d582d94a865-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Lock "cinder-1cd518e6-bbc9-463b-a04d-5d582d94a865-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Acquiring lock "cinder-quobyte-1cd518e6-bbc9-463b-a04d-5d582d94a865" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Lock "cinder-quobyte-1cd518e6-bbc9-463b-a04d-5d582d94a865" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:06 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de4ff6b-7a42-4d18-a7de-e1c2c9f517e3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:06 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 Aug 26 19:07:06 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:07 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865" returned: 0 in 0.421s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:07 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865 Aug 26 19:07:07 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:07 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-1cd518e6-bbc9-463b-a04d-5d582d94a865" returned: 0 in 0.274s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Lock "cinder-quobyte-1cd518e6-bbc9-463b-a04d-5d582d94a865" released by "delete_volume" :: held 0.739s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Created reservations ['5f652201-75c1-4321-8d3e-7897b59320d4', 'd6de6999-3ecb-48c4-a38e-b0045a76e384', '5bfc49f1-30c8-46ad-bd96-631fa28072f4', '712a728f-53b3-4258-b239-318374f06507'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:07 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:07 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:07 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:07 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Deleted volume successfully. Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9dc4e24f-c043-4319-a81a-6e0714f96e05 tempest-ProjectReaderTests-412745454 None] Lock "cinder-1cd518e6-bbc9-463b-a04d-5d582d94a865-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Acquiring lock "cinder-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Lock "cinder-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Acquiring lock "cinder-quobyte-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Lock "cinder-quobyte-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e6afc-d908-44c1-8cb4-6f3722dcedf3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:08 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 Aug 26 19:07:08 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:08 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7" returned: 0 in 0.373s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:08 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7 Aug 26 19:07:08 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:08 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7" returned: 0 in 0.267s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Lock "cinder-quobyte-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7" released by "delete_volume" :: held 0.685s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Created reservations ['948f4d32-35d1-4c24-883e-7c6e67cff144', 'e6d8d8bc-0c84-457c-9bbf-75d5d84bef5c', 'f671be6f-56e4-43db-a8e2-68ddfdaaab24', '5e9d18be-6993-4cf2-b955-071c5af3ca2d'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:08 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:08 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:09 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.276s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:09 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:09 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Deleted volume successfully. Aug 26 19:07:09 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d38a137d-67fc-4930-bf0a-1b2427b03439 tempest-VolumesNegativeTest-569508466 None] Lock "cinder-09e7ccb6-71a2-4a1f-8566-10a2e990f5c7-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:18 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=86,cinder:UPDATE=120,cinder:INSERT=35,cinder:DELETE=7 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=114,cinder:SELECT=80,cinder:INSERT=22,cinder:DELETE=12 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (a524186f-4a66-4ad6-80fa-ad12a57883ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215b3407-f655-4318-a676-37346274d040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215b3407-f655-4318-a676-37346274d040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1503578451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df00e3f-8fe3-4fb9-8156-512b117e9ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0971be731dd4447fa1467251f3a3eda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:20Z,use_quota=True,user_id='c818f54e65c24661afb0c3f7036b9e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1dc8cf-4517-47a2-93bf-ae51597fbaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1dc8cf-4517-47a2-93bf-ae51597fbaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189d977b-d0d1-4ca7-9d05-c20f49847b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189d977b-d0d1-4ca7-9d05-c20f49847b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df00e3f-8fe3-4fb9-8156-512b117e9ad5', 'volume_name': 'volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa8a8d6-dabe-4fce-8f1e-d3b628604e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa8a8d6-dabe-4fce-8f1e-d3b628604e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca3c10f-dc07-4e1b-9a76-a5861cb7086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:19 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Volume 6df00e3f-8fe3-4fb9-8156-512b117e9ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5', 'volume_size': 1} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1503578451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df00e3f-8fe3-4fb9-8156-512b117e9ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0971be731dd4447fa1467251f3a3eda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:20Z,use_quota=True,user_id='c818f54e65c24661afb0c3f7036b9e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Creating volume 6df00e3f-8fe3-4fb9-8156-512b117e9ad5 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:07:19 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:07:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:19 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 1073741824 Aug 26 19:07:19 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:20 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 1073741824" returned: 0 in 0.427s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:20 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 Aug 26 19:07:20 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:20 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" returned: 0 in 0.239s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:07:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca3c10f-dc07-4e1b-9a76-a5861cb7086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe724185-779f-47f9-a788-f55e21e6fb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:20 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Volume volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 (6df00e3f-8fe3-4fb9-8156-512b117e9ad5): created successfully Aug 26 19:07:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe724185-779f-47f9-a788-f55e21e6fb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (a524186f-4a66-4ad6-80fa-ad12a57883ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:20 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c9c118d8-41ce-4034-907f-39c56133b9c2 tempest-VolumesSnapshotTestJSON-1366532532 None] Created volume successfully. Aug 26 19:07:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Creating offline snapshot 64a35470-04dd-4020-aca7-6a49ca956992 of volume 6df00e3f-8fe3-4fb9-8156-512b117e9ad5 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:07:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34b9998-10ef-43ca-9c0a-64978012080b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:21 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 Aug 26 19:07:21 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:21 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" returned: 0 in 0.372s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:21 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 1G Aug 26 19:07:21 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:21 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 1G" returned: 0 in 0.410s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:21 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 Aug 26 19:07:21 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:22 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992" returned: 0 in 0.306s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:22 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 is being set with open permissions: ugo+rw Aug 26 19:07:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:22 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 Aug 26 19:07:22 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:22 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992" returned: 0 in 0.249s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:22 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.info Aug 26 19:07:22 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:22 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.info" returned: 0 in 0.253s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:22 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.info is being set with open permissions: ugo+rw Aug 26 19:07:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:22 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.info Aug 26 19:07:22 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:22 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.info" returned: 0 in 0.270s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:23 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ea632789-9a2c-4158-b9cb-06e8654d3969 tempest-VolumesSnapshotTestJSON-1366532532 None] Create snapshot completed successfully Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-64a35470-04dd-4020-aca7-6a49ca956992-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-64a35470-04dd-4020-aca7-6a49ca956992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-64a35470-04dd-4020-aca7-6a49ca956992" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-64a35470-04dd-4020-aca7-6a49ca956992" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Deleting offline snapshot 64a35470-04dd-4020-aca7-6a49ca956992 of volume 6df00e3f-8fe3-4fb9-8156-512b117e9ad5 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] snapshot_file for this snap is: volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b4b77a-0d25-4f7f-b6b0-29be7423034b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:23 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 Aug 26 19:07:23 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:23 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992" returned: 0 in 0.375s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafb1685-e390-43c1-a2e5-f78e717e1564]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:23 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 Aug 26 19:07:23 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:24 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" returned: 0 in 0.357s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:24 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 Aug 26 19:07:24 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:24 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992" returned: 0 in 0.337s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:24 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992 Aug 26 19:07:24 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:24 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5.64a35470-04dd-4020-aca7-6a49ca956992" returned: 0 in 0.269s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-64a35470-04dd-4020-aca7-6a49ca956992" released by "_delete_snapshot" :: held 1.449s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" released by "delete_snapshot" :: held 1.471s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:24 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Created reservations ['08493bf8-43fb-434a-a03f-c4531ed211d5', '408d7261-c614-4324-87f6-a9f77104a32c', '5790c442-464d-4a19-839e-fc0706615124', '30690997-9e66-44ab-a312-861ab4533fce'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:24 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Delete snapshot completed successfully. Aug 26 19:07:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6ef5d69-91bf-4b4d-b6b1-1b8aa480b62d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-64a35470-04dd-4020-aca7-6a49ca956992-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:25 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (dfb4eb37-8e25-46ba-899e-a94a17ff3a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e66028-fc6d-48cb-82f6-110848a5c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e66028-fc6d-48cb-82f6-110848a5c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-606325477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871ef143-acad-4af5-9a69-03d94d7c8de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0971be731dd4447fa1467251f3a3eda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:26Z,use_quota=True,user_id='c818f54e65c24661afb0c3f7036b9e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47487d2-6a0f-484c-a2d1-79ef04c57a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47487d2-6a0f-484c-a2d1-79ef04c57a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e8aa08-b5b3-4e25-8a1c-2267cd4d2612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e8aa08-b5b3-4e25-8a1c-2267cd4d2612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871ef143-acad-4af5-9a69-03d94d7c8de1', 'volume_name': 'volume-871ef143-acad-4af5-9a69-03d94d7c8de1', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdcc0fb-ce59-4dc2-b402-5210a295687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdcc0fb-ce59-4dc2-b402-5210a295687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302ee973-755f-4576-bd09-a793ad2fef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:26 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Volume 871ef143-acad-4af5-9a69-03d94d7c8de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871ef143-acad-4af5-9a69-03d94d7c8de1', 'volume_size': 1} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-606325477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871ef143-acad-4af5-9a69-03d94d7c8de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0971be731dd4447fa1467251f3a3eda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:26Z,use_quota=True,user_id='c818f54e65c24661afb0c3f7036b9e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Creating volume 871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:07:26 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:26 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 1073741824 Aug 26 19:07:26 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:26 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 1073741824" returned: 0 in 0.410s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:26 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 Aug 26 19:07:26 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:26 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1" returned: 0 in 0.254s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302ee973-755f-4576-bd09-a793ad2fef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871ef143-acad-4af5-9a69-03d94d7c8de1', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37f9c87-e6c8-4111-bf57-09d287797ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:26 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Volume volume-871ef143-acad-4af5-9a69-03d94d7c8de1 (871ef143-acad-4af5-9a69-03d94d7c8de1): created successfully Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37f9c87-e6c8-4111-bf57-09d287797ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (dfb4eb37-8e25-46ba-899e-a94a17ff3a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-822d68ca-bb80-4b36-92f5-86891dc53a7d tempest-VolumesSnapshotTestJSON-1366532532 None] Created volume successfully. Aug 26 19:07:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Creating offline snapshot c86c80b0-dea4-4372-a74d-04f7115bd6c8 of volume 871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:07:27 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcc9b35-3b27-4540-981e-2e2d138b8c8c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:27 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 Aug 26 19:07:27 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:27 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1" returned: 0 in 0.351s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:27 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 1G Aug 26 19:07:27 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:27 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 1G" returned: 0 in 0.390s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871ef143-acad-4af5-9a69-03d94d7c8de1 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:27 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871ef143-acad-4af5-9a69-03d94d7c8de1 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 Aug 26 19:07:27 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:28 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-871ef143-acad-4af5-9a69-03d94d7c8de1 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8" returned: 0 in 0.297s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:28 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 is being set with open permissions: ugo+rw Aug 26 19:07:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:28 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 Aug 26 19:07:28 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:28 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8" returned: 0 in 0.244s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:28 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.info Aug 26 19:07:28 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:28 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.info" returned: 0 in 0.259s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:28 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.info is being set with open permissions: ugo+rw Aug 26 19:07:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:28 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.info Aug 26 19:07:28 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:29 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.info" returned: 0 in 0.236s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-81b5166f-5b25-4e67-8225-12e814ee87e4 tempest-VolumesSnapshotTestJSON-1366532532 None] Create snapshot completed successfully Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (49568c57-9b66-46a6-af4f-c94b0b4d9a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c568aaf-aeb4-4514-a07a-9fbd9bf08b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c568aaf-aeb4-4514-a07a-9fbd9bf08b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1127324612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872a49d0-fcf2-4189-b020-3fae3cb88079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0971be731dd4447fa1467251f3a3eda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c86c80b0-dea4-4372-a74d-04f7115bd6c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:30Z,use_quota=True,user_id='c818f54e65c24661afb0c3f7036b9e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31e9a57-3225-4b45-b6d0-dc2a5ae5dcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31e9a57-3225-4b45-b6d0-dc2a5ae5dcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7248489-433f-43f3-91f5-795b94f590fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7248489-433f-43f3-91f5-795b94f590fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '872a49d0-fcf2-4189-b020-3fae3cb88079', 'volume_name': 'volume-872a49d0-fcf2-4189-b020-3fae3cb88079', 'volume_size': 2, 'snapshot_id': 'c86c80b0-dea4-4372-a74d-04f7115bd6c8'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef09245-84ab-4f13-a8ae-d2223e5292c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef09245-84ab-4f13-a8ae-d2223e5292c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803f47b8-49e6-4226-a7db-7a7a1629abda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:29 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Volume 872a49d0-fcf2-4189-b020-3fae3cb88079: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-872a49d0-fcf2-4189-b020-3fae3cb88079', 'volume_size': 2, 'snapshot_id': 'c86c80b0-dea4-4372-a74d-04f7115bd6c8'} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-c86c80b0-dea4-4372-a74d-04f7115bd6c8-872a49d0-fcf2-4189-b020-3fae3cb88079" by "_create_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-c86c80b0-dea4-4372-a74d-04f7115bd6c8-872a49d0-fcf2-4189-b020-3fae3cb88079" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Creating volume 872a49d0-fcf2-4189-b020-3fae3cb88079 from snapshot c86c80b0-dea4-4372-a74d-04f7115bd6c8 {{(pid=93671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-872a49d0-fcf2-4189-b020-3fae3cb88079" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-872a49d0-fcf2-4189-b020-3fae3cb88079" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] snapshot: c86c80b0-dea4-4372-a74d-04f7115bd6c8, volume: 872a49d0-fcf2-4189-b020-3fae3cb88079, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c72a261-85ff-4f75-9462-23126c48bec9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:30 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 Aug 26 19:07:30 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:30 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8" returned: 0 in 0.365s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-871ef143-acad-4af5-9a69-03d94d7c8de1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:07:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[492252a5-55ec-430c-b6e8-16ecb357b72a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:30 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 Aug 26 19:07:30 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:30 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1" returned: 0 in 0.358s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:07:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:07:30 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:07:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:30 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 Aug 26 19:07:30 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:34 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079" returned: 0 in 3.957s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:07:34 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Converted 1024.00 MB image at 258.73 MB/s Aug 26 19:07:34 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 is being set with open permissions: ugo+rw Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:34 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 Aug 26 19:07:34 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:34 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079" returned: 0 in 0.227s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-872a49d0-fcf2-4189-b020-3fae3cb88079" released by "_copy_volume_from_snapshot" :: held 4.981s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-c86c80b0-dea4-4372-a74d-04f7115bd6c8-872a49d0-fcf2-4189-b020-3fae3cb88079" released by "_create_volume_from_snapshot" :: held 5.038s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.053s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803f47b8-49e6-4226-a7db-7a7a1629abda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872a49d0-fcf2-4189-b020-3fae3cb88079', 'volume_size': 2, 'snapshot_id': 'c86c80b0-dea4-4372-a74d-04f7115bd6c8'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a1d80c-5f04-4025-a835-07e170b087c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:34 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Volume volume-872a49d0-fcf2-4189-b020-3fae3cb88079 (872a49d0-fcf2-4189-b020-3fae3cb88079): created successfully Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a1d80c-5f04-4025-a835-07e170b087c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (49568c57-9b66-46a6-af4f-c94b0b4d9a10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-24f29814-7ae0-43a4-94be-5b48906d5e8a tempest-VolumesSnapshotTestJSON-1366532532 None] Created volume successfully. Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-872a49d0-fcf2-4189-b020-3fae3cb88079-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-872a49d0-fcf2-4189-b020-3fae3cb88079-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-872a49d0-fcf2-4189-b020-3fae3cb88079" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-872a49d0-fcf2-4189-b020-3fae3cb88079" acquired by "delete_volume" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7a3e4c-35a2-449b-838f-206cc3c805bd]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:35 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 Aug 26 19:07:35 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:35 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079" returned: 0 in 0.341s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:35 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079 Aug 26 19:07:35 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:35 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-872a49d0-fcf2-4189-b020-3fae3cb88079" returned: 0 in 0.237s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-872a49d0-fcf2-4189-b020-3fae3cb88079" released by "delete_volume" :: held 0.615s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Created reservations ['e381b375-5a3a-4c55-a1b0-6672aca3b6bd', 'f0c92778-8205-4d08-be02-636932222128', 'bfdf1008-66f5-4aeb-b41a-b426e2a5efda', '2f92e676-08a0-470a-bb3a-117a978e6bc7'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:36 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:36 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:36 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.270s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:36 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Deleted volume successfully. Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d5e53393-ab26-4d14-9adb-4c85a9c8b45b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-872a49d0-fcf2-4189-b020-3fae3cb88079-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-c86c80b0-dea4-4372-a74d-04f7115bd6c8-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-c86c80b0-dea4-4372-a74d-04f7115bd6c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-871ef143-acad-4af5-9a69-03d94d7c8de1" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-871ef143-acad-4af5-9a69-03d94d7c8de1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-c86c80b0-dea4-4372-a74d-04f7115bd6c8" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-c86c80b0-dea4-4372-a74d-04f7115bd6c8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Deleting offline snapshot c86c80b0-dea4-4372-a74d-04f7115bd6c8 of volume 871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] snapshot_file for this snap is: volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a30ac-357a-4262-8d88-c8d75c07f8da]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:36 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 Aug 26 19:07:36 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:36 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8" returned: 0 in 0.335s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-871ef143-acad-4af5-9a69-03d94d7c8de1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ddb444-ae9c-4888-89c2-7abe0f44595a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:37 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 Aug 26 19:07:37 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:37 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1" returned: 0 in 0.519s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:37 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 Aug 26 19:07:37 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:37 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8" returned: 0 in 0.318s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:37 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8 Aug 26 19:07:37 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:38 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1.c86c80b0-dea4-4372-a74d-04f7115bd6c8" returned: 0 in 0.250s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-c86c80b0-dea4-4372-a74d-04f7115bd6c8" released by "_delete_snapshot" :: held 1.512s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-871ef143-acad-4af5-9a69-03d94d7c8de1" released by "delete_snapshot" :: held 1.534s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Created reservations ['876141e5-eb36-4e92-a632-6a777a78e52a', '7210c930-70cd-4f0c-ae22-39228c23ac44', '49c198d5-d444-423d-824b-ceac71f20c76', '2614348a-1c35-46ee-8d45-2a5b5d471a20'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Delete snapshot completed successfully. Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c18f6b98-090e-4e37-b0c7-5bad540b8182 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-c86c80b0-dea4-4372-a74d-04f7115bd6c8-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-871ef143-acad-4af5-9a69-03d94d7c8de1-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-871ef143-acad-4af5-9a69-03d94d7c8de1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-871ef143-acad-4af5-9a69-03d94d7c8de1" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-871ef143-acad-4af5-9a69-03d94d7c8de1" acquired by "delete_volume" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98a6cee-a163-4d91-800b-1220d7ec6e82]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:38 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 Aug 26 19:07:38 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:39 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1" returned: 0 in 0.346s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:39 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1 Aug 26 19:07:39 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:39 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-871ef143-acad-4af5-9a69-03d94d7c8de1" returned: 0 in 0.240s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-871ef143-acad-4af5-9a69-03d94d7c8de1" released by "delete_volume" :: held 0.644s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Created reservations ['7df22447-c755-4748-97ff-638d1cd69857', '7a4ae58d-3c23-4030-8601-924436dcc4dd', '8f7c884a-80eb-47bb-917c-a77a794e5484', '412ea0eb-1271-4d7d-906f-11a2ec15c50c'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:39 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:39 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:39 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.236s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:39 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Deleted volume successfully. Aug 26 19:07:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-32f3b5fb-4a44-443f-9fba-87382b5b81f7 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-871ef143-acad-4af5-9a69-03d94d7c8de1-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (550aeeab-7e8e-47af-8327-0fb255b72983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1724ff-d8cc-44cc-b8f5-fee965b89a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1724ff-d8cc-44cc-b8f5-fee965b89a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-370681424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c9e883-a8c2-4baa-b7f1-47b2e3ec807d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0971be731dd4447fa1467251f3a3eda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:40Z,use_quota=True,user_id='c818f54e65c24661afb0c3f7036b9e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03ce96e-8b63-46d6-8a84-e86002f47808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03ce96e-8b63-46d6-8a84-e86002f47808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba2cff5-e015-4984-b062-c07ec2742c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba2cff5-e015-4984-b062-c07ec2742c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c9e883-a8c2-4baa-b7f1-47b2e3ec807d', 'volume_name': 'volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b557f0a4-845c-480c-bff7-2c804bdb9932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b557f0a4-845c-480c-bff7-2c804bdb9932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d713241-843b-4234-ac22-d1a63aa1ef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:40 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Volume 29c9e883-a8c2-4baa-b7f1-47b2e3ec807d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d', 'volume_size': 1} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-370681424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c9e883-a8c2-4baa-b7f1-47b2e3ec807d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0971be731dd4447fa1467251f3a3eda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:40Z,use_quota=True,user_id='c818f54e65c24661afb0c3f7036b9e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Creating volume 29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:07:40 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:40 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d 1073741824 Aug 26 19:07:40 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:40 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d 1073741824" returned: 0 in 0.419s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:40 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d Aug 26 19:07:40 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:41 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" returned: 0 in 0.232s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d713241-843b-4234-ac22-d1a63aa1ef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c16dbc4-5fba-4b10-9844-a55d63dd7073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:41 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Volume volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d (29c9e883-a8c2-4baa-b7f1-47b2e3ec807d): created successfully Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c16dbc4-5fba-4b10-9844-a55d63dd7073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (550aeeab-7e8e-47af-8327-0fb255b72983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f3ee5c00-f806-4d40-9968-1bfd306137d4 tempest-VolumesSnapshotTestJSON-1366532532 None] Created volume successfully. Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Creating offline snapshot 0b50e39a-7704-482d-9190-1e76ea0465f7 of volume 29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b31734a-bb30-4a60-994a-68f1bbb6aac8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:41 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d Aug 26 19:07:41 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:41 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" returned: 0 in 0.340s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:41 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 1G Aug 26 19:07:41 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:42 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 1G" returned: 0 in 0.390s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:42 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 Aug 26 19:07:42 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:42 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7" returned: 0 in 0.304s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:42 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 is being set with open permissions: ugo+rw Aug 26 19:07:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:42 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 Aug 26 19:07:42 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:42 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7" returned: 0 in 0.234s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:42 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.info Aug 26 19:07:42 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:43 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.info" returned: 0 in 0.239s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:43 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.info is being set with open permissions: ugo+rw Aug 26 19:07:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:43 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.info Aug 26 19:07:43 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:43 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.info" returned: 0 in 0.237s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:43 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4eab939f-1405-4bd8-b57e-4b7a6307bcd1 tempest-VolumesSnapshotTestJSON-1366532532 None] Create snapshot completed successfully Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (9895ff4d-963d-4419-bd12-e78fcf50aec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742e653a-0918-4779-b053-99fbe6b15c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742e653a-0918-4779-b053-99fbe6b15c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-505501132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365d9f19-edd1-478d-b0ca-40253ab92d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0971be731dd4447fa1467251f3a3eda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0b50e39a-7704-482d-9190-1e76ea0465f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:07:44Z,use_quota=True,user_id='c818f54e65c24661afb0c3f7036b9e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874f555e-b725-4c9e-84a2-d0678e92c818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874f555e-b725-4c9e-84a2-d0678e92c818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93762afa-0107-435f-a9f7-7910c79acc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93762afa-0107-435f-a9f7-7910c79acc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '365d9f19-edd1-478d-b0ca-40253ab92d02', 'volume_name': 'volume-365d9f19-edd1-478d-b0ca-40253ab92d02', 'volume_size': 1, 'snapshot_id': '0b50e39a-7704-482d-9190-1e76ea0465f7'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0372ee-3e61-4a9c-887d-8a0a2e2fca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0372ee-3e61-4a9c-887d-8a0a2e2fca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba181e1-e2a3-4c39-bcf2-485526a25da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:44 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Volume 365d9f19-edd1-478d-b0ca-40253ab92d02: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-365d9f19-edd1-478d-b0ca-40253ab92d02', 'volume_size': 1, 'snapshot_id': '0b50e39a-7704-482d-9190-1e76ea0465f7'} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-0b50e39a-7704-482d-9190-1e76ea0465f7-365d9f19-edd1-478d-b0ca-40253ab92d02" by "_create_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-0b50e39a-7704-482d-9190-1e76ea0465f7-365d9f19-edd1-478d-b0ca-40253ab92d02" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Creating volume 365d9f19-edd1-478d-b0ca-40253ab92d02 from snapshot 0b50e39a-7704-482d-9190-1e76ea0465f7 {{(pid=93671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-365d9f19-edd1-478d-b0ca-40253ab92d02" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-365d9f19-edd1-478d-b0ca-40253ab92d02" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] snapshot: 0b50e39a-7704-482d-9190-1e76ea0465f7, volume: 365d9f19-edd1-478d-b0ca-40253ab92d02, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd893087-e50e-487f-b4af-21e9d62d6b9d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:44 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 Aug 26 19:07:44 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:44 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7" returned: 0 in 0.368s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c579c-0c87-491a-8b98-568146246e6a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:44 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d Aug 26 19:07:44 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:45 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" returned: 0 in 0.383s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:07:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:07:45 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:07:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:45 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 Aug 26 19:07:45 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:49 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02" returned: 0 in 4.003s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:07:49 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Converted 1024.00 MB image at 255.74 MB/s Aug 26 19:07:49 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 is being set with open permissions: ugo+rw Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:49 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 Aug 26 19:07:49 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:49 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02" returned: 0 in 0.234s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-365d9f19-edd1-478d-b0ca-40253ab92d02" released by "_copy_volume_from_snapshot" :: held 5.065s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-0b50e39a-7704-482d-9190-1e76ea0465f7-365d9f19-edd1-478d-b0ca-40253ab92d02" released by "_create_volume_from_snapshot" :: held 5.128s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.142s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba181e1-e2a3-4c39-bcf2-485526a25da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365d9f19-edd1-478d-b0ca-40253ab92d02', 'volume_size': 1, 'snapshot_id': '0b50e39a-7704-482d-9190-1e76ea0465f7'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85425bf3-c8fa-4370-8e0e-d42017668433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:07:49 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Volume volume-365d9f19-edd1-478d-b0ca-40253ab92d02 (365d9f19-edd1-478d-b0ca-40253ab92d02): created successfully Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85425bf3-c8fa-4370-8e0e-d42017668433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Flow 'volume_create_manager' (9895ff4d-963d-4419-bd12-e78fcf50aec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:07:49 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8a221f7c-0754-407f-be56-e2b5bc7866ff tempest-VolumesSnapshotTestJSON-1366532532 None] Created volume successfully. Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-365d9f19-edd1-478d-b0ca-40253ab92d02-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-365d9f19-edd1-478d-b0ca-40253ab92d02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-365d9f19-edd1-478d-b0ca-40253ab92d02" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-365d9f19-edd1-478d-b0ca-40253ab92d02" acquired by "delete_volume" :: waited 0.012s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4387aed8-9dc8-4c23-ae2e-b0e02c89f8ea]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:49 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 Aug 26 19:07:49 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:50 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02" returned: 0 in 0.351s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:50 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02 Aug 26 19:07:50 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:50 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-365d9f19-edd1-478d-b0ca-40253ab92d02" returned: 0 in 0.239s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-365d9f19-edd1-478d-b0ca-40253ab92d02" released by "delete_volume" :: held 0.630s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Created reservations ['006092e3-343f-4dad-9365-35aa60e967c2', '3a64b07c-b2cb-4033-bbb3-449048ea6a1f', '0e43c92d-ae4b-42be-8cd9-2bc391300758', '7ca00830-481e-417d-a743-e666cdb61de9'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:50 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:50 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:50 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.258s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:50 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Deleted volume successfully. Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-412bd7fb-76d4-4fb4-8481-c2662d5c395e tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-365d9f19-edd1-478d-b0ca-40253ab92d02-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-0b50e39a-7704-482d-9190-1e76ea0465f7-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-0b50e39a-7704-482d-9190-1e76ea0465f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-0b50e39a-7704-482d-9190-1e76ea0465f7" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-0b50e39a-7704-482d-9190-1e76ea0465f7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Deleting offline snapshot 0b50e39a-7704-482d-9190-1e76ea0465f7 of volume 29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] snapshot_file for this snap is: volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78e52b3-d721-40a4-8d55-9304ae323e95]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:51 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 Aug 26 19:07:51 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:51 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7" returned: 0 in 0.354s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:07:51 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1896de-07fa-4f84-89aa-34be32d9bf5b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:51 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d Aug 26 19:07:51 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:51 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" returned: 0 in 0.509s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:51 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 Aug 26 19:07:51 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:52 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7" returned: 0 in 0.314s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:52 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7 Aug 26 19:07:52 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:52 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d.0b50e39a-7704-482d-9190-1e76ea0465f7" returned: 0 in 0.240s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-0b50e39a-7704-482d-9190-1e76ea0465f7" released by "_delete_snapshot" :: held 1.506s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" released by "delete_snapshot" :: held 1.527s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:52 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Created reservations ['830548e9-d291-4d8e-860b-18b61c8a57be', '4de232d4-5261-460d-91e5-65750b773d69', '773b48de-822a-4d0d-8dea-7038904f8aa7', 'b7870b09-a2d7-4319-9a9c-14d8e1a79f52'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:52 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Delete snapshot completed successfully. Aug 26 19:07:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-adc5eb61-b8a8-4631-aece-a39306d6ff8b tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-0b50e39a-7704-482d-9190-1e76ea0465f7-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebe4123-cf4b-4a6e-8468-2c63083f25ba]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:53 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d Aug 26 19:07:53 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:53 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" returned: 0 in 0.361s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:53 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d Aug 26 19:07:53 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:53 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" returned: 0 in 0.239s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d" released by "delete_volume" :: held 0.657s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Created reservations ['b55a8dc3-807a-466d-86e3-c5b322975d52', '72069d6d-6eeb-4054-8f0a-14239690a0e0', '642aa1d7-8591-4fae-8444-3b74571f055c', 'cab574e3-2105-458d-ab96-c0c12ee49e90'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:53 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:53 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:54 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.239s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:54 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Deleted volume successfully. Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0402060d-a609-4f06-baea-19f0cb6423c0 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-29c9e883-a8c2-4baa-b7f1-47b2e3ec807d-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-6df00e3f-8fe3-4fb9-8156-512b117e9ad5-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-6df00e3f-8fe3-4fb9-8156-512b117e9ad5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "cinder-quobyte-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" acquired by "delete_volume" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[90499357-e283-42f3-a5a6-6a99d2bd31ce]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:54 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:54 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:54 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 Aug 26 19:07:54 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:54 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.243s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:07:54 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" returned: 0 in 0.371s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:54 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5 Aug 26 19:07:54 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:55 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" returned: 0 in 0.229s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-quobyte-6df00e3f-8fe3-4fb9-8156-512b117e9ad5" released by "delete_volume" :: held 0.653s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Created reservations ['f984c66c-eae4-457d-a909-91042f3bcbb3', '9141ec0c-cfe0-48e7-ac67-385f7d086ced', 'e25bfdc5-0c9a-4c21-a47c-b9b62f49e49e', '8d6f8f19-389e-4a73-a2f3-95be9a1b8f2f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:07:55 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:07:55 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:07:55 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.239s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:07:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Deleted volume successfully. Aug 26 19:07:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-79e79145-320a-408b-9146-c9a3df7789e8 tempest-VolumesSnapshotTestJSON-1366532532 None] Lock "cinder-6df00e3f-8fe3-4fb9-8156-512b117e9ad5-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:08:05 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=68,cinder:INSERT=20,cinder:UPDATE=75,cinder:DELETE=4 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:08:08 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=79,cinder:SELECT=75,cinder:INSERT=20,cinder:DELETE=9 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Flow 'volume_create_manager' (59ddaf50-71d3-4cd4-93aa-6bdb432dcbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8d914b-fe11-4988-80bb-955eb585c266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8d914b-fe11-4988-80bb-955eb585c266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-30937837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd6ad3c-2fec-4b35-8c5e-034eb0db999f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb7870c193a40feb8bf337aac24d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:08:22Z,use_quota=True,user_id='c6a17ba40fde4c17803a9bd0558a46c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5876945f-525c-43ea-aa58-63a92ec9a486),volume_type_id=5876945f-525c-43ea-aa58-63a92ec9a486)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289967c0-14ab-46b0-b565-a50e7b8bbc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289967c0-14ab-46b0-b565-a50e7b8bbc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b242366-9e74-4757-981d-c448a0507580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b242366-9e74-4757-981d-c448a0507580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dd6ad3c-2fec-4b35-8c5e-034eb0db999f', 'volume_name': 'volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03515d2b-cd83-418a-832d-2115a0b70325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03515d2b-cd83-418a-832d-2115a0b70325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43e921f-0808-4364-a605-7ddfaade5295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Volume 5dd6ad3c-2fec-4b35-8c5e-034eb0db999f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f', 'volume_size': 1} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-30937837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dd6ad3c-2fec-4b35-8c5e-034eb0db999f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb7870c193a40feb8bf337aac24d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:08:22Z,use_quota=True,user_id='c6a17ba40fde4c17803a9bd0558a46c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5876945f-525c-43ea-aa58-63a92ec9a486),volume_type_id=5876945f-525c-43ea-aa58-63a92ec9a486)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Creating volume 5dd6ad3c-2fec-4b35-8c5e-034eb0db999f {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:08:22 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:22 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f 1073741824 Aug 26 19:08:22 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Flow 'volume_create_manager' (e099a1bc-5ca7-4a72-af0a-bfa13124b0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52a62ec-fe23-4deb-a55e-4e373636815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52a62ec-fe23-4deb-a55e-4e373636815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1913950609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eacfd5f-6a4d-4614-9730-88192a63f4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb7870c193a40feb8bf337aac24d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:08:23Z,use_quota=True,user_id='c6a17ba40fde4c17803a9bd0558a46c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52b3d3fd-3c91-4925-a71d-ce368f790b73),volume_type_id=52b3d3fd-3c91-4925-a71d-ce368f790b73)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb62bfb3-6b32-4149-9a0c-e24c70bd8736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb62bfb3-6b32-4149-9a0c-e24c70bd8736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1e938a-fbb8-4e97-8484-1249a4d3751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1e938a-fbb8-4e97-8484-1249a4d3751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eacfd5f-6a4d-4614-9730-88192a63f4e9', 'volume_name': 'volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5144f43b-dec0-4c60-abf0-cc130eb99649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5144f43b-dec0-4c60-abf0-cc130eb99649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fe7ced-cdc6-4566-b140-3a922e37144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:22 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Volume 8eacfd5f-6a4d-4614-9730-88192a63f4e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9', 'volume_size': 1} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:08:22 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f 1073741824" returned: 0 in 0.508s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:22 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f Aug 26 19:08:22 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:23 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f" returned: 0 in 0.292s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1913950609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eacfd5f-6a4d-4614-9730-88192a63f4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb7870c193a40feb8bf337aac24d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:08:23Z,use_quota=True,user_id='c6a17ba40fde4c17803a9bd0558a46c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52b3d3fd-3c91-4925-a71d-ce368f790b73),volume_type_id=52b3d3fd-3c91-4925-a71d-ce368f790b73)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Creating volume 8eacfd5f-6a4d-4614-9730-88192a63f4e9 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:08:23 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:23 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 1073741824 Aug 26 19:08:23 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43e921f-0808-4364-a605-7ddfaade5295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedbc804-94ed-4ddf-9c2d-b2d58ca2c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:23 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Volume volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f (5dd6ad3c-2fec-4b35-8c5e-034eb0db999f): created successfully Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedbc804-94ed-4ddf-9c2d-b2d58ca2c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Flow 'volume_create_manager' (59ddaf50-71d3-4cd4-93aa-6bdb432dcbd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:08:23 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b2e739d8-dcb1-4207-856c-74f822ef9f9c tempest-TestInstancesWithCinderVolumes-139908141 None] Created volume successfully. Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Flow 'volume_create_manager' (70ce8a1d-f9a2-4461-8de1-b428ff2f6773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb792ae-7e66-4481-bc9a-c6c14a7cf2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb792ae-7e66-4481-bc9a-c6c14a7cf2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1194361003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b901c1-9851-4b8e-8716-79c5fae14528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb7870c193a40feb8bf337aac24d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:08:23Z,use_quota=True,user_id='c6a17ba40fde4c17803a9bd0558a46c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23d58067-6084-4c10-98f7-b38a64a63928),volume_type_id=23d58067-6084-4c10-98f7-b38a64a63928)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bf3278-ce8d-4378-af3b-9f44d0793aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bf3278-ce8d-4378-af3b-9f44d0793aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55c7a58-e068-4e85-814e-a6c5ea1c8ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55c7a58-e068-4e85-814e-a6c5ea1c8ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2b901c1-9851-4b8e-8716-79c5fae14528', 'volume_name': 'volume-b2b901c1-9851-4b8e-8716-79c5fae14528', 'volume_size': 1, 'image_id': 'fbd2def9-3806-446f-abf6-1bd2172e55d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbd2def9-3806-446f-abf6-1bd2172e55d4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--891167889', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb7870c193a40feb8bf337aac24d2c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbd2def9-3806-446f-abf6-1bd2172e55d4', 'created_at': datetime.datetime(2026, 8, 26, 17, 8, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 8, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbd2def9-3806-446f-abf6-1bd2172e55d4/file', 'properties': {}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925bcf53-26f6-497a-8196-1fd5f1937baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925bcf53-26f6-497a-8196-1fd5f1937baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163de1f8-6b41-493e-b550-aec54e010fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:23 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Volume b2b901c1-9851-4b8e-8716-79c5fae14528: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2b901c1-9851-4b8e-8716-79c5fae14528', 'volume_size': 1, 'image_id': 'fbd2def9-3806-446f-abf6-1bd2172e55d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbd2def9-3806-446f-abf6-1bd2172e55d4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--891167889', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb7870c193a40feb8bf337aac24d2c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbd2def9-3806-446f-abf6-1bd2172e55d4', 'created_at': datetime.datetime(2026, 8, 26, 17, 8, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 8, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbd2def9-3806-446f-abf6-1bd2172e55d4/file', 'properties': {}}, 'image_service': } Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Trying to clone b2b901c1-9851-4b8e-8716-79c5fae14528 from image fbd2def9-3806-446f-abf6-1bd2172e55d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbd2def9-3806-446f-abf6-1bd2172e55d4', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 19:08:23 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 1073741824" returned: 0 in 0.496s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:23 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 Aug 26 19:08:23 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:24 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9" returned: 0 in 0.258s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:08:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:08:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fe7ced-cdc6-4566-b140-3a922e37144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a107445e-33dd-44af-88b0-af6264bc19fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:24 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Volume volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 (8eacfd5f-6a4d-4614-9730-88192a63f4e9): created successfully Aug 26 19:08:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a107445e-33dd-44af-88b0-af6264bc19fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Flow 'volume_create_manager' (e099a1bc-5ca7-4a72-af0a-bfa13124b0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:08:24 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4eebc455-6026-47b2-9b73-5a0487dad57c tempest-TestInstancesWithCinderVolumes-139908141 None] Created volume successfully. Aug 26 19:08:26 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD, size 20.69 MB, duration 2.85 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 19:08:26 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Image download 20.69 MB at 7.26 MB/s Aug 26 19:08:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70c3ffe-6078-45dd-887e-bb8f70b14dac]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:08:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:26 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD Aug 26 19:08:26 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:26 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:26 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Temporary image fbd2def9-3806-446f-abf6-1bd2172e55d4 is fetched for user c6a17ba40fde4c17803a9bd0558a46c6. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 19:08:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dddba0-10c8-44ef-a753-2df147264463]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:08:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:27 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD Aug 26 19:08:27 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:27 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1194361003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b901c1-9851-4b8e-8716-79c5fae14528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb7870c193a40feb8bf337aac24d2c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:08:23Z,use_quota=True,user_id='c6a17ba40fde4c17803a9bd0558a46c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23d58067-6084-4c10-98f7-b38a64a63928),volume_type_id=23d58067-6084-4c10-98f7-b38a64a63928)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Creating volume b2b901c1-9851-4b8e-8716-79c5fae14528 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:08:27 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:27 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 1073741824 Aug 26 19:08:27 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:27 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 1073741824" returned: 0 in 0.460s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:27 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 Aug 26 19:08:27 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:28 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528" returned: 0 in 0.252s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Attempting download of fbd2def9-3806-446f-abf6-1bd2172e55d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbd2def9-3806-446f-abf6-1bd2172e55d4', 'metadata': {}}])) to volume b2b901c1-9851-4b8e-8716-79c5fae14528. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[386144a9-f202-4984-a42f-1147a526e4f4]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbd2def9-3806-446f-abf6-1bd2172e55d4_ecsy_y1q {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:28 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbd2def9-3806-446f-abf6-1bd2172e55d4_ecsy_y1q Aug 26 19:08:28 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:28 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbd2def9-3806-446f-abf6-1bd2172e55d4_ecsy_y1q" returned: 0 in 0.331s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd2def9-3806-446f-abf6-1bd2172e55d4_ecsy_y1q {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:28 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd2def9-3806-446f-abf6-1bd2172e55d4_ecsy_y1q Aug 26 19:08:28 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:28 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd2def9-3806-446f-abf6-1bd2172e55d4_ecsy_y1q" returned: 1 in 0.320s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbd2def9-3806-446f-abf6-1bd2172e55d4_ecsy_y1q' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[415024c1-c559-4076-979d-b3e0dffcfc70]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:08:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:28 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD Aug 26 19:08:28 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:29 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD" returned: 0 in 0.309s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:29 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] fbd2def9-3806-446f-abf6-1bd2172e55d4 was qcow2, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 19:08:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:29 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 Aug 26 19:08:29 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:30 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528" returned: 0 in 1.570s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:30 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbd2def9-3806-446f-abf6-1bd2172e55d4_a0lpwo87devstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:08:30 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Converted 112.00 MB image at 71.25 MB/s Aug 26 19:08:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:30 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 1G Aug 26 19:08:30 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:31 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 1G" returned: 0 in 0.309s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Downloaded image fbd2def9-3806-446f-abf6-1bd2172e55d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbd2def9-3806-446f-abf6-1bd2172e55d4', 'metadata': {}}])) to volume b2b901c1-9851-4b8e-8716-79c5fae14528 successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Temporary image fbd2def9-3806-446f-abf6-1bd2172e55d4 for user c6a17ba40fde4c17803a9bd0558a46c6 is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Marking volume b2b901c1-9851-4b8e-8716-79c5fae14528 as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Copying metadata from image fbd2def9-3806-446f-abf6-1bd2172e55d4 to b2b901c1-9851-4b8e-8716-79c5fae14528. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Creating volume glance metadata for volume b2b901c1-9851-4b8e-8716-79c5fae14528 backed by image fbd2def9-3806-446f-abf6-1bd2172e55d4 with: {'image_id': 'fbd2def9-3806-446f-abf6-1bd2172e55d4', 'image_name': 'tempest-scenario-img--891167889', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163de1f8-6b41-493e-b550-aec54e010fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b901c1-9851-4b8e-8716-79c5fae14528', 'volume_size': 1, 'image_id': 'fbd2def9-3806-446f-abf6-1bd2172e55d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbd2def9-3806-446f-abf6-1bd2172e55d4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--891167889', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4eb7870c193a40feb8bf337aac24d2c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbd2def9-3806-446f-abf6-1bd2172e55d4', 'created_at': datetime.datetime(2026, 8, 26, 17, 8, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 8, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbd2def9-3806-446f-abf6-1bd2172e55d4/file', 'properties': {}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3c7061-f740-4288-a602-bfe49503e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:08:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Volume volume-b2b901c1-9851-4b8e-8716-79c5fae14528 (b2b901c1-9851-4b8e-8716-79c5fae14528): created successfully Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3c7061-f740-4288-a602-bfe49503e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:08:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Flow 'volume_create_manager' (70ce8a1d-f9a2-4461-8de1-b428ff2f6773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:08:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b52bce9f-f4e2-4778-a7bc-d82d7ef33d09 tempest-TestInstancesWithCinderVolumes-139908141 None] Created volume successfully. Aug 26 19:08:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-48e4a137-34bb-4d85-99b1-07395d6e368c req-5a9b3f28-58e0-46f1-a4bf-53519aca461e tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:08:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-48e4a137-34bb-4d85-99b1-07395d6e368c req-5a9b3f28-58e0-46f1-a4bf-53519aca461e tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:08:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-48e4a137-34bb-4d85-99b1-07395d6e368c req-5a9b3f28-58e0-46f1-a4bf-53519aca461e tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:08:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-48e4a137-34bb-4d85-99b1-07395d6e368c req-5a9b3f28-58e0-46f1-a4bf-53519aca461e tempest-TestInstancesWithCinderVolumes-139908141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-b2b901c1-9851-4b8e-8716-79c5fae14528', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98582f7f-c617-4aab-be0b-b3fd7bc1d3ec', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:08:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-48e4a137-34bb-4d85-99b1-07395d6e368c req-5a9b3f28-58e0-46f1-a4bf-53519aca461e tempest-TestInstancesWithCinderVolumes-139908141 None] attachment_update completed successfully. Aug 26 19:08:44 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=19,cinder:UPDATE=11,cinder:INSERT=7,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:08:44 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=13,cinder:SELECT=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:08:54 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:08:54 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:08:54 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.298s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:08:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:09:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-a07fd61a-7376-47e4-9ef9-154ab6a88535 req-ea8e4f4b-e7bf-47d1-96de-eed0155c4902 tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:09:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-a07fd61a-7376-47e4-9ef9-154ab6a88535 req-ea8e4f4b-e7bf-47d1-96de-eed0155c4902 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:09:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-a07fd61a-7376-47e4-9ef9-154ab6a88535 req-ea8e4f4b-e7bf-47d1-96de-eed0155c4902 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:09:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-a07fd61a-7376-47e4-9ef9-154ab6a88535 req-ea8e4f4b-e7bf-47d1-96de-eed0155c4902 tempest-TestInstancesWithCinderVolumes-139908141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbd17e1d-ebff-458e-b352-184df13c0eca', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:09:07 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-a07fd61a-7376-47e4-9ef9-154ab6a88535 req-ea8e4f4b-e7bf-47d1-96de-eed0155c4902 tempest-TestInstancesWithCinderVolumes-139908141 None] attachment_update completed successfully. Aug 26 19:09:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d85b8f21-c7ec-4e04-adb3-ce0602693889 req-e3189959-10ae-4876-9bfb-da3074656f1c tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:09:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d85b8f21-c7ec-4e04-adb3-ce0602693889 req-e3189959-10ae-4876-9bfb-da3074656f1c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:09:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-d85b8f21-c7ec-4e04-adb3-ce0602693889 req-e3189959-10ae-4876-9bfb-da3074656f1c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:09:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-d85b8f21-c7ec-4e04-adb3-ce0602693889 req-e3189959-10ae-4876-9bfb-da3074656f1c tempest-TestInstancesWithCinderVolumes-139908141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e748b1af-c52b-4e07-bd56-d63b589d6e22', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:09:09 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-d85b8f21-c7ec-4e04-adb3-ce0602693889 req-e3189959-10ae-4876-9bfb-da3074656f1c tempest-TestInstancesWithCinderVolumes-139908141 None] attachment_update completed successfully. Aug 26 19:09:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-637c3691-5e21-401b-871a-c108fd692796 req-cd9bffe4-9c6f-4c83-a37b-6346e14a71a5 tempest-TestInstancesWithCinderVolumes-139908141 None] Terminate volume connection completed successfully. Aug 26 19:09:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-637c3691-5e21-401b-871a-c108fd692796 req-cd9bffe4-9c6f-4c83-a37b-6346e14a71a5 tempest-TestInstancesWithCinderVolumes-139908141 None] Deleting attachment dbd17e1d-ebff-458e-b352-184df13c0eca. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:09:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "cinder-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:09:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:09:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "cinder-quobyte-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:09:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-quobyte-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:09:14 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edde500-84dc-4abb-aae6-335364d848fa]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:09:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:14 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f Aug 26 19:09:14 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:15 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f" returned: 0 in 0.375s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:15 devstack sudo[109844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f Aug 26 19:09:15 devstack sudo[109844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:15 devstack sudo[109844]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f" returned: 0 in 0.333s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-quobyte-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f" released by "delete_volume" :: held 0.750s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:09:15 devstack cinder-volume[93671]: WARNING cinder.quota [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176932267-1753753788 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176932267-1753753788, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:09:15 devstack cinder-volume[93671]: WARNING cinder.quota [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176932267-1753753788 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176932267-1753753788, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Created reservations ['c068f6fe-6933-4845-b39a-f9a0a3eb399f', '85118676-424b-4e6d-b5b5-acb0a25c8f70', '3aef6897-d109-492c-90a3-5674c09e9db2', '5366e4bf-ace7-410c-abb4-2592748165b6'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:15 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:09:15 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:15 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.254s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:09:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Deleted volume successfully. Aug 26 19:09:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0911d08d-b917-45f8-b4d1-b6990c13e4dc tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-5dd6ad3c-2fec-4b35-8c5e-034eb0db999f-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:09:18 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-38399eb2-2945-4cbd-86c1-b657a995d23a req-371d9220-600c-4b2e-8c69-c250b667b336 tempest-TestInstancesWithCinderVolumes-139908141 None] Terminate volume connection completed successfully. Aug 26 19:09:18 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-38399eb2-2945-4cbd-86c1-b657a995d23a req-371d9220-600c-4b2e-8c69-c250b667b336 tempest-TestInstancesWithCinderVolumes-139908141 None] Deleting attachment e748b1af-c52b-4e07-bd56-d63b589d6e22. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "cinder-8eacfd5f-6a4d-4614-9730-88192a63f4e9-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-8eacfd5f-6a4d-4614-9730-88192a63f4e9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "cinder-quobyte-8eacfd5f-6a4d-4614-9730-88192a63f4e9" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-quobyte-8eacfd5f-6a4d-4614-9730-88192a63f4e9" acquired by "delete_volume" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a63bd0-a583-4945-92e4-141fd998b3cc]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:19 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 Aug 26 19:09:19 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:19 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9" returned: 0 in 0.396s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:19 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9 Aug 26 19:09:19 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:19 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-8eacfd5f-6a4d-4614-9730-88192a63f4e9" returned: 0 in 0.276s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-quobyte-8eacfd5f-6a4d-4614-9730-88192a63f4e9" released by "delete_volume" :: held 0.724s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:09:19 devstack cinder-volume[93671]: WARNING cinder.quota [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1153756436-1613819164 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1153756436-1613819164, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:09:19 devstack cinder-volume[93671]: WARNING cinder.quota [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1153756436-1613819164 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1153756436-1613819164, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:09:19 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Created reservations ['ac3c1d50-2b24-4099-9eba-16b308954862', 'f81ae252-67c2-4c1b-968c-229d5c053d19', '80709c12-77e8-4439-b37f-a2f9795faa22', 'b1d0f7ea-1708-4445-92cc-58389f03ae14'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:09:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:09:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:09:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:09:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:09:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:09:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:20 devstack sudo[109887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:09:20 devstack sudo[109887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:20 devstack sudo[109887]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.281s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:20 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:09:20 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Deleted volume successfully. Aug 26 19:09:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ca4e853-d329-4813-bf20-c861408a5c35 tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-8eacfd5f-6a4d-4614-9730-88192a63f4e9-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:09:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-64bfa4cc-ed0d-424d-98f1-25f13fc03319 req-e5dffbaa-c704-463f-98a1-5193657e0897 tempest-TestInstancesWithCinderVolumes-139908141 None] Terminate volume connection completed successfully. Aug 26 19:09:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-64bfa4cc-ed0d-424d-98f1-25f13fc03319 req-e5dffbaa-c704-463f-98a1-5193657e0897 tempest-TestInstancesWithCinderVolumes-139908141 None] Deleting attachment 98582f7f-c617-4aab-be0b-b3fd7bc1d3ec. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "cinder-b2b901c1-9851-4b8e-8716-79c5fae14528-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-b2b901c1-9851-4b8e-8716-79c5fae14528-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "cinder-quobyte-b2b901c1-9851-4b8e-8716-79c5fae14528" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-quobyte-b2b901c1-9851-4b8e-8716-79c5fae14528" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09f518a-f6bf-4a0e-af37-e5347f5dd8f8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:24 devstack sudo[109920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 Aug 26 19:09:24 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:24 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528" returned: 0 in 0.343s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:24 devstack sudo[109925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528 Aug 26 19:09:24 devstack sudo[109925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:24 devstack sudo[109925]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-b2b901c1-9851-4b8e-8716-79c5fae14528" returned: 0 in 0.234s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-quobyte-b2b901c1-9851-4b8e-8716-79c5fae14528" released by "delete_volume" :: held 0.615s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:09:24 devstack cinder-volume[93671]: WARNING cinder.quota [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-308569161-1129774858 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-308569161-1129774858, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:09:24 devstack cinder-volume[93671]: WARNING cinder.quota [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-308569161-1129774858 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-308569161-1129774858, it is now deprecated. Please use the default quota class for default quota. Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Created reservations ['c9e50997-b4f6-4ec5-b389-6c0e8d0f5a18', 'bcc37687-3f2d-49d3-853d-cdd6ba91b935', '27069f80-7a3e-4ee0-a4cf-4b5fd69cc180', '821d224a-573f-4fea-9888-5e8586de79bc'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:09:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:24 devstack sudo[109928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:09:24 devstack sudo[109928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:25 devstack sudo[109928]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.232s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:25 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:09:25 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Deleted volume successfully. Aug 26 19:09:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b649cc02-5d82-460a-a05f-4dd4a14a782c tempest-TestInstancesWithCinderVolumes-139908141 None] Lock "cinder-b2b901c1-9851-4b8e-8716-79c5fae14528-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:09:34 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=31,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:09:35 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=31,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:09:54 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:09:54 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:09:54 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.273s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:09:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:10:08 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:10:08 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Flow 'volume_create_manager' (46ac1113-b9d5-4c21-a1e4-21cadbc2da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3fbcef-8dcf-4d1b-a921-e46b08dc599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3fbcef-8dcf-4d1b-a921-e46b08dc599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-286900559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3a0263-ec06-4f29-bf6b-676680580b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5a443fca0247159ec32168eb665596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:10:28Z,use_quota=True,user_id='64b1140cc44a4c2ebc6df87e0cd545ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1701daca-6b24-41b6-8b55-2598b6ebd0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1701daca-6b24-41b6-8b55-2598b6ebd0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdc99ab-6ebb-4216-9262-560527ae7682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdc99ab-6ebb-4216-9262-560527ae7682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3a0263-ec06-4f29-bf6b-676680580b21', 'volume_name': 'volume-6e3a0263-ec06-4f29-bf6b-676680580b21', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6569905-e67f-4a65-8f7f-144ba9ccf5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6569905-e67f-4a65-8f7f-144ba9ccf5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f312647a-46b3-4a6d-a8ae-b0d7eaca0dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:10:27 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Volume 6e3a0263-ec06-4f29-bf6b-676680580b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3a0263-ec06-4f29-bf6b-676680580b21', 'volume_size': 1} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-286900559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3a0263-ec06-4f29-bf6b-676680580b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5a443fca0247159ec32168eb665596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:10:28Z,use_quota=True,user_id='64b1140cc44a4c2ebc6df87e0cd545ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Creating volume 6e3a0263-ec06-4f29-bf6b-676680580b21 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:10:27 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:10:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:10:28 devstack sudo[110127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21 1073741824 Aug 26 19:10:28 devstack sudo[110127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:10:28 devstack sudo[110127]: pam_unix(sudo:session): session closed for user root Aug 26 19:10:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21 1073741824" returned: 0 in 0.412s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:10:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:10:28 devstack sudo[110132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21 Aug 26 19:10:28 devstack sudo[110132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:10:28 devstack sudo[110132]: pam_unix(sudo:session): session closed for user root Aug 26 19:10:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21" returned: 0 in 0.255s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:10:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:10:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:10:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f312647a-46b3-4a6d-a8ae-b0d7eaca0dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3a0263-ec06-4f29-bf6b-676680580b21', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:10:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecb5cdf-c17e-4bcf-8937-d75db78a8fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:10:28 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Volume volume-6e3a0263-ec06-4f29-bf6b-676680580b21 (6e3a0263-ec06-4f29-bf6b-676680580b21): created successfully Aug 26 19:10:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecb5cdf-c17e-4bcf-8937-d75db78a8fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:10:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Flow 'volume_create_manager' (46ac1113-b9d5-4c21-a1e4-21cadbc2da28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:10:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7441553c-4806-4136-a635-9ff67769a2d6 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Created volume successfully. Aug 26 19:10:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-0edc3f7e-7e0b-4a9d-9ad9-60b3c82f492a req-548f7662-b611-47a7-b492-0f5a8d00910c tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:10:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-0edc3f7e-7e0b-4a9d-9ad9-60b3c82f492a req-548f7662-b611-47a7-b492-0f5a8d00910c tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:10:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-0edc3f7e-7e0b-4a9d-9ad9-60b3c82f492a req-548f7662-b611-47a7-b492-0f5a8d00910c tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:10:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-0edc3f7e-7e0b-4a9d-9ad9-60b3c82f492a req-548f7662-b611-47a7-b492-0f5a8d00910c tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-6e3a0263-ec06-4f29-bf6b-676680580b21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fa6bb36-30cc-4e02-aa2d-a5fc11884e20', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:10:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-0edc3f7e-7e0b-4a9d-9ad9-60b3c82f492a req-548f7662-b611-47a7-b492-0f5a8d00910c tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] attachment_update completed successfully. Aug 26 19:10:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-4e7fe8b2-ccd9-430a-beb5-eea90fc97577 req-8305f967-6bdb-4c00-9004-933e269acf51 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Terminate volume connection completed successfully. Aug 26 19:10:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-4e7fe8b2-ccd9-430a-beb5-eea90fc97577 req-8305f967-6bdb-4c00-9004-933e269acf51 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Deleting attachment 9fa6bb36-30cc-4e02-aa2d-a5fc11884e20. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:10:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Acquiring lock "cinder-6e3a0263-ec06-4f29-bf6b-676680580b21-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:10:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "cinder-6e3a0263-ec06-4f29-bf6b-676680580b21-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:10:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Acquiring lock "cinder-quobyte-6e3a0263-ec06-4f29-bf6b-676680580b21" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:10:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "cinder-quobyte-6e3a0263-ec06-4f29-bf6b-676680580b21" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:10:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d0d309-16aa-46e0-aa3a-993ccd812b68]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:10:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:10:33 devstack sudo[110560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21 Aug 26 19:10:33 devstack sudo[110560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:10:33 devstack sudo[110560]: pam_unix(sudo:session): session closed for user root Aug 26 19:10:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21" returned: 0 in 0.372s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:10:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:10:33 devstack sudo[110565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21 Aug 26 19:10:33 devstack sudo[110565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:10:34 devstack sudo[110565]: pam_unix(sudo:session): session closed for user root Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-6e3a0263-ec06-4f29-bf6b-676680580b21" returned: 0 in 0.239s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "cinder-quobyte-6e3a0263-ec06-4f29-bf6b-676680580b21" released by "delete_volume" :: held 0.652s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Created reservations ['fbce9c80-1141-4c45-a17e-745c749eab87', 'afb92414-a831-4bb5-8108-deb48eec42cc', 'fbae20a3-0db2-4708-b2f5-24fcd0b832b9', 'f52013db-3709-481a-871a-8e0a1367518c'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:10:34 devstack sudo[110568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:10:34 devstack sudo[110568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:10:34 devstack sudo[110568]: pam_unix(sudo:session): session closed for user root Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.252s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:10:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Deleted volume successfully. Aug 26 19:10:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-56518221-f0f8-49d5-ac75-097e708cd054 tempest-TestServerVolumeAttachScenarioOldVersion-1785282395 None] Lock "cinder-6e3a0263-ec06-4f29-bf6b-676680580b21-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:10:44 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=15,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:10:44 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=10,cinder:SELECT=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:10:54 devstack sudo[110648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:10:54 devstack sudo[110648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:10:54 devstack sudo[110648]: pam_unix(sudo:session): session closed for user root Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.310s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:10:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Flow 'volume_create_manager' (b103c4c7-532a-451b-ad94-1b0c40d6d804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a1b0b5-d9c1-4d69-9344-92ee0170f9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a1b0b5-d9c1-4d69-9344-92ee0170f9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1897883551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2510a60-ef9c-46e3-ba9b-a2efcffc2af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b4a5191de64a9ea6533e53f116f210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:11:10Z,use_quota=True,user_id='f55be79246f44c2fa41bfb7c95ca692a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e963bc74-9b89-44b8-b0b8-10f8a36d1d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e963bc74-9b89-44b8-b0b8-10f8a36d1d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5569a503-5d7e-4cae-b1cc-04f65cc0d03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5569a503-5d7e-4cae-b1cc-04f65cc0d03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2510a60-ef9c-46e3-ba9b-a2efcffc2af8', 'volume_name': 'volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68812d5-a5af-4421-84bd-7770ebb70e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68812d5-a5af-4421-84bd-7770ebb70e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8fabfc-959c-4940-b816-1320d7903d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:11:09 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Volume c2510a60-ef9c-46e3-ba9b-a2efcffc2af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8', 'volume_size': 1} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1897883551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2510a60-ef9c-46e3-ba9b-a2efcffc2af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b4a5191de64a9ea6533e53f116f210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:11:10Z,use_quota=True,user_id='f55be79246f44c2fa41bfb7c95ca692a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Creating volume c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:11:09 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:11:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:09 devstack sudo[110657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 1073741824 Aug 26 19:11:09 devstack sudo[110657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:10 devstack sudo[110657]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 1073741824" returned: 0 in 0.412s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:10 devstack sudo[110663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 Aug 26 19:11:10 devstack sudo[110663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:10 devstack sudo[110663]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8" returned: 0 in 0.251s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:11:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:11:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8fabfc-959c-4940-b816-1320d7903d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:11:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73cce2e-0118-4c73-af8e-44555d7f136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:11:10 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Volume volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 (c2510a60-ef9c-46e3-ba9b-a2efcffc2af8): created successfully Aug 26 19:11:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73cce2e-0118-4c73-af8e-44555d7f136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:11:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Flow 'volume_create_manager' (b103c4c7-532a-451b-ad94-1b0c40d6d804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:11:10 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-42c9c68c-cde4-493c-83b5-efc50081a822 tempest-TestImageHashVerification-543460286 None] Created volume successfully. Aug 26 19:11:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:11:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:11:11 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[771473a3-44bf-407b-a299-ac2b2362abc3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:11:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:11 devstack sudo[110666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 Aug 26 19:11:11 devstack sudo[110666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:12 devstack sudo[110666]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8" returned: 0 in 0.393s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fef37d-2d49-4544-8cf9-34d3c3a09eb9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:11:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:12 devstack sudo[110671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 Aug 26 19:11:12 devstack sudo[110671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:12 devstack sudo[110671]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8" returned: 0 in 0.364s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 /opt/stack/data/cinder/conversion/c2510a60-ef9c-46e3-ba9b-a2efcffc2af8.temp_image.8e8dc7ee-b7ce-4228-b271-93f2e1c1378ak6xjcqul.img {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:12 devstack sudo[110676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 /opt/stack/data/cinder/conversion/c2510a60-ef9c-46e3-ba9b-a2efcffc2af8.temp_image.8e8dc7ee-b7ce-4228-b271-93f2e1c1378ak6xjcqul.img Aug 26 19:11:12 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:16 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 /opt/stack/data/cinder/conversion/c2510a60-ef9c-46e3-ba9b-a2efcffc2af8.temp_image.8e8dc7ee-b7ce-4228-b271-93f2e1c1378ak6xjcqul.img" returned: 0 in 3.784s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6d9ab1-69ef-44fe-af2a-edacf47abba6]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:11:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:16 devstack sudo[110689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 Aug 26 19:11:16 devstack sudo[110689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:16 devstack sudo[110689]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8" returned: 0 in 0.532s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:16 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8, size 1024.00 MB, duration 3.79 sec, destination /opt/stack/data/cinder/conversion/c2510a60-ef9c-46e3-ba9b-a2efcffc2af8.temp_image.8e8dc7ee-b7ce-4228-b271-93f2e1c1378ak6xjcqul.img {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:11:16 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Converted 1024.00 MB image at 270.51 MB/s Aug 26 19:11:16 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] 8e8dc7ee-b7ce-4228-b271-93f2e1c1378a was raw, no need to convert to raw {{(pid=93671) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 19:11:21 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:11:26 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:11:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.887s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:11:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Uploaded volume to glance image-id: 8e8dc7ee-b7ce-4228-b271-93f2e1c1378a. {{(pid=93671) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 19:11:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ee1f5ac9-4c54-449c-9285-692daeb8d0a4 tempest-TestImageHashVerification-543460286 None] Copy volume to image completed successfully. Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Acquiring lock "cinder-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Lock "cinder-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Acquiring lock "cinder-quobyte-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Lock "cinder-quobyte-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8" acquired by "delete_volume" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c07779e-de3d-45ea-add1-a6791a1b4f5f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:37 devstack sudo[110699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 Aug 26 19:11:37 devstack sudo[110699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:37 devstack sudo[110699]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8" returned: 0 in 0.349s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:37 devstack sudo[110705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8 Aug 26 19:11:37 devstack sudo[110705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:37 devstack sudo[110705]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8" returned: 0 in 0.245s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Lock "cinder-quobyte-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8" released by "delete_volume" :: held 0.628s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Created reservations ['8fef4b2c-f488-4168-bfc1-52652c6edb9d', 'fe5c520e-8dba-4047-bc26-41a2a6805569', 'a89b0713-61c9-4dac-8390-56bbd962e4e7', '2c585d63-478a-470a-9a20-d80f16980b92'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:11:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:37 devstack sudo[110742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:11:37 devstack sudo[110742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:38 devstack sudo[110742]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.269s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:38 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:11:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Deleted volume successfully. Aug 26 19:11:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ab9df73c-c6e5-4775-8c44-8e141b1e9c0c tempest-TestImageHashVerification-543460286 None] Lock "cinder-c2510a60-ef9c-46e3-ba9b-a2efcffc2af8-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:11:47 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:11:48 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:11:54 devstack sudo[110760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:11:54 devstack sudo[110760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:11:54 devstack sudo[110760]: pam_unix(sudo:session): session closed for user root Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.298s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:11:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:12:08 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:12:08 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Flow 'volume_create_manager' (d5090e6f-70ee-4eb9-b4c6-96bc035ac914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28710a8-750c-4e68-a1a5-27a7640f9b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28710a8-750c-4e68-a1a5-27a7640f9b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-11020033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967081aa-1cd4-4e0e-ad3a-7dec928b8e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36eee486b3c641e8a0e7bca46ecd5655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:12:09Z,use_quota=True,user_id='7a36b755b8db4097866bfc5db03646f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed569a15-b37f-4c5c-a063-1d609b0054e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed569a15-b37f-4c5c-a063-1d609b0054e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1373282-1c1c-424f-b94c-aaadde3f800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1373282-1c1c-424f-b94c-aaadde3f800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967081aa-1cd4-4e0e-ad3a-7dec928b8e78', 'volume_name': 'volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0d96cc-43f8-4a8f-8eee-e8b7991d14ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0d96cc-43f8-4a8f-8eee-e8b7991d14ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a4d9f4-d41a-4e91-9824-f630f0dd7fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:09 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Volume 967081aa-1cd4-4e0e-ad3a-7dec928b8e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78', 'volume_size': 1} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-11020033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967081aa-1cd4-4e0e-ad3a-7dec928b8e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36eee486b3c641e8a0e7bca46ecd5655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:12:09Z,use_quota=True,user_id='7a36b755b8db4097866bfc5db03646f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Creating volume 967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:12:09 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:09 devstack sudo[110768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 1073741824 Aug 26 19:12:09 devstack sudo[110768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:09 devstack sudo[110768]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 1073741824" returned: 0 in 0.414s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:09 devstack sudo[110774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 Aug 26 19:12:09 devstack sudo[110774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:10 devstack sudo[110774]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" returned: 0 in 0.260s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:12:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:12:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a4d9f4-d41a-4e91-9824-f630f0dd7fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3cbefa-1746-4b0d-950d-dad99bd3214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:10 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Volume volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 (967081aa-1cd4-4e0e-ad3a-7dec928b8e78): created successfully Aug 26 19:12:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3cbefa-1746-4b0d-950d-dad99bd3214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Flow 'volume_create_manager' (d5090e6f-70ee-4eb9-b4c6-96bc035ac914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:12:10 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-33512568-afbe-4c3f-b417-598e648e0b31 tempest-TestStampPattern-1578819914 None] Created volume successfully. Aug 26 19:12:20 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:12:20 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:12:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-90fd0d93-4963-4d2a-9885-763d9b707f2d req-bbc331cd-5e8b-48b2-a99f-a6aaf83f937e tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:12:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-90fd0d93-4963-4d2a-9885-763d9b707f2d req-bbc331cd-5e8b-48b2-a99f-a6aaf83f937e tempest-TestStampPattern-1578819914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:12:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-90fd0d93-4963-4d2a-9885-763d9b707f2d req-bbc331cd-5e8b-48b2-a99f-a6aaf83f937e tempest-TestStampPattern-1578819914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:12:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-90fd0d93-4963-4d2a-9885-763d9b707f2d req-bbc331cd-5e8b-48b2-a99f-a6aaf83f937e tempest-TestStampPattern-1578819914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bf48fee-34a1-41db-b122-e8f9f8ac765e', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:12:39 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-90fd0d93-4963-4d2a-9885-763d9b707f2d req-bbc331cd-5e8b-48b2-a99f-a6aaf83f937e tempest-TestStampPattern-1578819914 None] attachment_update completed successfully. Aug 26 19:12:44 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-820a3c84-4966-4c43-88aa-af8a90ee77c1 req-da92722f-61aa-41f5-8d2a-6eb7b8e77153 tempest-TestStampPattern-1578819914 None] Terminate volume connection completed successfully. Aug 26 19:12:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-820a3c84-4966-4c43-88aa-af8a90ee77c1 req-da92722f-61aa-41f5-8d2a-6eb7b8e77153 tempest-TestStampPattern-1578819914 None] Deleting attachment 1bf48fee-34a1-41db-b122-e8f9f8ac765e. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:12:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:12:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:12:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Creating offline snapshot 1b360cd4-20d1-43e9-a84e-513def6bd0d0 of volume 967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:12:45 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf70d64-e353-469e-9e53-f4f5b1ff6fd3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:12:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:45 devstack sudo[111391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 Aug 26 19:12:45 devstack sudo[111391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:45 devstack sudo[111391]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" returned: 0 in 0.346s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:45 devstack sudo[111396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 1G Aug 26 19:12:45 devstack sudo[111396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:46 devstack sudo[111396]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 1G" returned: 0 in 0.405s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:46 devstack sudo[111402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 Aug 26 19:12:46 devstack sudo[111402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:46 devstack sudo[111402]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0" returned: 0 in 0.287s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:46 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 is being set with open permissions: ugo+rw Aug 26 19:12:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:46 devstack sudo[111407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 Aug 26 19:12:46 devstack sudo[111407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:46 devstack sudo[111407]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0" returned: 0 in 0.251s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:46 devstack sudo[111410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.info Aug 26 19:12:46 devstack sudo[111410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:46 devstack sudo[111410]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.info" returned: 0 in 0.259s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:46 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.info is being set with open permissions: ugo+rw Aug 26 19:12:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:46 devstack sudo[111413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.info Aug 26 19:12:46 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:47 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.info" returned: 0 in 0.242s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:12:47 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ac60c5e9-2b53-4a9c-bd34-ab6f0fb369c2 tempest-TestStampPattern-1578819914 None] Create snapshot completed successfully Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Flow 'volume_create_manager' (efc8dbca-3b81-47e7-98f9-2caa46ca9856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ee2472-3201-4d86-bfc1-af35ebd58963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ee2472-3201-4d86-bfc1-af35ebd58963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1941718651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7300c0e-0b63-43ac-b144-aece533bcfdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36eee486b3c641e8a0e7bca46ecd5655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b360cd4-20d1-43e9-a84e-513def6bd0d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:12:54Z,use_quota=True,user_id='7a36b755b8db4097866bfc5db03646f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c45977-3821-4a72-9838-11bdfbad65b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c45977-3821-4a72-9838-11bdfbad65b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d6faae-1ec6-4b0b-a0a0-e78cf7a6830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d6faae-1ec6-4b0b-a0a0-e78cf7a6830f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7300c0e-0b63-43ac-b144-aece533bcfdf', 'volume_name': 'volume-c7300c0e-0b63-43ac-b144-aece533bcfdf', 'volume_size': 1, 'snapshot_id': '1b360cd4-20d1-43e9-a84e-513def6bd0d0'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea856301-d22f-4a28-b21c-31c77fccc508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea856301-d22f-4a28-b21c-31c77fccc508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512788c1-96da-4ba9-988e-6b6a23ad3ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:12:54 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Volume c7300c0e-0b63-43ac-b144-aece533bcfdf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7300c0e-0b63-43ac-b144-aece533bcfdf', 'volume_size': 1, 'snapshot_id': '1b360cd4-20d1-43e9-a84e-513def6bd0d0'} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Acquiring lock "cinder-quobyte-1b360cd4-20d1-43e9-a84e-513def6bd0d0-c7300c0e-0b63-43ac-b144-aece533bcfdf" by "_create_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-1b360cd4-20d1-43e9-a84e-513def6bd0d0-c7300c0e-0b63-43ac-b144-aece533bcfdf" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Creating volume c7300c0e-0b63-43ac-b144-aece533bcfdf from snapshot 1b360cd4-20d1-43e9-a84e-513def6bd0d0 {{(pid=93671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Acquiring lock "cinder-quobyte-c7300c0e-0b63-43ac-b144-aece533bcfdf" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-c7300c0e-0b63-43ac-b144-aece533bcfdf" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] snapshot: 1b360cd4-20d1-43e9-a84e-513def6bd0d0, volume: c7300c0e-0b63-43ac-b144-aece533bcfdf, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d692497c-915c-49a5-83c1-6c36dceab849]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:54 devstack sudo[111455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 Aug 26 19:12:54 devstack sudo[111455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:54 devstack sudo[111457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:12:54 devstack sudo[111457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:54 devstack sudo[111455]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0" returned: 0 in 0.406s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa0b24f-ac6b-4b10-8db4-6dbabdac456a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:54 devstack sudo[111457]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.278s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:12:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:12:54 devstack sudo[111466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 Aug 26 19:12:54 devstack sudo[111466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:12:55 devstack sudo[111466]: pam_unix(sudo:session): session closed for user root Aug 26 19:12:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" returned: 0 in 0.465s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:12:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:12:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:12:55 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:12:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:12:55 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf Aug 26 19:12:55 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:01 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf" returned: 0 in 5.784s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:13:01 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Converted 1024.00 MB image at 176.99 MB/s Aug 26 19:13:01 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf is being set with open permissions: ugo+rw Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:01 devstack sudo[111498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf Aug 26 19:13:01 devstack sudo[111498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:01 devstack sudo[111498]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf" returned: 0 in 0.307s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-c7300c0e-0b63-43ac-b144-aece533bcfdf" released by "_copy_volume_from_snapshot" :: held 7.083s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-1b360cd4-20d1-43e9-a84e-513def6bd0d0-c7300c0e-0b63-43ac-b144-aece533bcfdf" released by "_create_volume_from_snapshot" :: held 7.171s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.199s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512788c1-96da-4ba9-988e-6b6a23ad3ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7300c0e-0b63-43ac-b144-aece533bcfdf', 'volume_size': 1, 'snapshot_id': '1b360cd4-20d1-43e9-a84e-513def6bd0d0'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3eb6051-dab0-4cb9-8e5e-93a960dcb83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:13:01 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Volume volume-c7300c0e-0b63-43ac-b144-aece533bcfdf (c7300c0e-0b63-43ac-b144-aece533bcfdf): created successfully Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3eb6051-dab0-4cb9-8e5e-93a960dcb83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:13:01 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Flow 'volume_create_manager' (efc8dbca-3b81-47e7-98f9-2caa46ca9856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:13:01 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-68c1502e-1e30-49c8-9a33-a64f81a5be33 tempest-TestStampPattern-1578819914 None] Created volume successfully. Aug 26 19:13:11 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:13:11 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=17,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:13:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-a23522a4-72cb-479a-a417-919292970c27 req-f1e8500f-e9a5-4fab-9395-043bcdd06cc9 tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:13:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-a23522a4-72cb-479a-a417-919292970c27 req-f1e8500f-e9a5-4fab-9395-043bcdd06cc9 tempest-TestStampPattern-1578819914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:13:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [req-a23522a4-72cb-479a-a417-919292970c27 req-f1e8500f-e9a5-4fab-9395-043bcdd06cc9 tempest-TestStampPattern-1578819914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:13:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-a23522a4-72cb-479a-a417-919292970c27 req-f1e8500f-e9a5-4fab-9395-043bcdd06cc9 tempest-TestStampPattern-1578819914 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935', 'name': 'volume-c7300c0e-0b63-43ac-b144-aece533bcfdf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9e01795-1d96-4910-b4de-a1f338683a48', 'enforce_multipath': True} {{(pid=93671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 19:13:44 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-a23522a4-72cb-479a-a417-919292970c27 req-f1e8500f-e9a5-4fab-9395-043bcdd06cc9 tempest-TestStampPattern-1578819914 None] attachment_update completed successfully. Aug 26 19:13:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [req-30b02be4-7cd9-4911-b76e-1a1bdfa489a8 req-9ec2d1eb-d4c5-41e8-9b63-3c21b26c99c9 tempest-TestStampPattern-1578819914 None] Terminate volume connection completed successfully. Aug 26 19:13:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [req-30b02be4-7cd9-4911-b76e-1a1bdfa489a8 req-9ec2d1eb-d4c5-41e8-9b63-3c21b26c99c9 tempest-TestStampPattern-1578819914 None] Deleting attachment b9e01795-1d96-4910-b4de-a1f338683a48. {{(pid=93671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 19:13:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Acquiring lock "cinder-c7300c0e-0b63-43ac-b144-aece533bcfdf-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:13:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Lock "cinder-c7300c0e-0b63-43ac-b144-aece533bcfdf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:13:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Acquiring lock "cinder-quobyte-c7300c0e-0b63-43ac-b144-aece533bcfdf" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:13:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-c7300c0e-0b63-43ac-b144-aece533bcfdf" acquired by "delete_volume" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:13:52 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e60e99e-9a99-4cba-b22a-589e465d5a49]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:13:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:52 devstack sudo[112125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf Aug 26 19:13:52 devstack sudo[112125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:52 devstack sudo[112125]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf" returned: 0 in 0.354s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:52 devstack sudo[112130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf Aug 26 19:13:52 devstack sudo[112130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:53 devstack sudo[112130]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c7300c0e-0b63-43ac-b144-aece533bcfdf" returned: 0 in 0.258s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-c7300c0e-0b63-43ac-b144-aece533bcfdf" released by "delete_volume" :: held 0.652s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Created reservations ['8402e67b-4551-4940-805f-378885d9dfbd', 'b8c59b0d-a74c-47c2-a0d5-8632cfd2c39d', '26dd9747-f23b-4329-aa46-4b0cd6152f3b', '38e4da47-1200-4295-8979-f43b4a730877'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:53 devstack sudo[112133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:13:53 devstack sudo[112133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:53 devstack sudo[112133]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.244s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:13:53 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Deleted volume successfully. Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8400b43b-de7c-446d-9cd5-1ed3999ee749 tempest-TestStampPattern-1578819914 None] Lock "cinder-c7300c0e-0b63-43ac-b144-aece533bcfdf-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Acquiring lock "cinder-1b360cd4-20d1-43e9-a84e-513def6bd0d0-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Lock "cinder-1b360cd4-20d1-43e9-a84e-513def6bd0d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Acquiring lock "cinder-quobyte-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Acquiring lock "cinder-quobyte-1b360cd4-20d1-43e9-a84e-513def6bd0d0" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-1b360cd4-20d1-43e9-a84e-513def6bd0d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Deleting offline snapshot 1b360cd4-20d1-43e9-a84e-513def6bd0d0 of volume 967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] snapshot_file for this snap is: volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d555ca8a-fd92-4ce3-8008-f8711b6c359d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:13:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:54 devstack sudo[112136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 Aug 26 19:13:54 devstack sudo[112136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:54 devstack sudo[112136]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0" returned: 0 in 0.365s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f847755-fc93-4235-9b25-4951fb1197be]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:54 devstack sudo[112142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 Aug 26 19:13:54 devstack sudo[112142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:54 devstack sudo[112144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:13:54 devstack sudo[112144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:54 devstack sudo[112144]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.248s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:13:54 devstack sudo[112142]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" returned: 0 in 0.530s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:54 devstack sudo[112150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 Aug 26 19:13:54 devstack sudo[112150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:55 devstack sudo[112150]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0" returned: 0 in 0.329s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:55 devstack sudo[112157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0 Aug 26 19:13:55 devstack sudo[112157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:55 devstack sudo[112157]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78.1b360cd4-20d1-43e9-a84e-513def6bd0d0" returned: 0 in 0.268s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-1b360cd4-20d1-43e9-a84e-513def6bd0d0" released by "_delete_snapshot" :: held 1.591s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:13:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" released by "delete_snapshot" :: held 1.613s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:13:55 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Created reservations ['fe2b3edb-d353-4116-bc5b-0aeb2a4da938', '4117ade4-9a85-4fa1-8076-63af69381b48', 'b9f7ed6d-3b85-4150-81db-1ff696905a3a', 'f1c1f8e2-4874-4db5-b36f-6c881ad176fa'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:13:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Delete snapshot completed successfully. Aug 26 19:13:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9cf12a46-d2ec-4522-a8c5-087bbfb60065 tempest-TestStampPattern-1578819914 None] Lock "cinder-1b360cd4-20d1-43e9-a84e-513def6bd0d0-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:13:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Acquiring lock "cinder-967081aa-1cd4-4e0e-ad3a-7dec928b8e78-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:13:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Lock "cinder-967081aa-1cd4-4e0e-ad3a-7dec928b8e78-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:13:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Acquiring lock "cinder-quobyte-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:13:59 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" acquired by "delete_volume" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:13:59 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e630eb8-d605-4ee6-8ce9-e32aee6de492]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:13:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:59 devstack sudo[112193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 Aug 26 19:13:59 devstack sudo[112193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:13:59 devstack sudo[112193]: pam_unix(sudo:session): session closed for user root Aug 26 19:13:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" returned: 0 in 0.347s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:13:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:13:59 devstack sudo[112198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78 Aug 26 19:13:59 devstack sudo[112198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:00 devstack sudo[112198]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" returned: 0 in 0.239s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Lock "cinder-quobyte-967081aa-1cd4-4e0e-ad3a-7dec928b8e78" released by "delete_volume" :: held 0.639s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Created reservations ['67b8d5bb-4330-49bb-8cab-2c7c5f4c2cd7', '89214dfb-8551-4c84-8da1-b4117d7ada00', 'b500c3e6-db14-44c8-ac4d-e90bc14813e9', '257cda48-54f9-4987-81f4-8e6b7ff64950'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:00 devstack sudo[112201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:00 devstack sudo[112201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:00 devstack sudo[112201]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.230s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:00 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Deleted volume successfully. Aug 26 19:14:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b415ba81-ca37-4a2b-a263-59b4917706aa tempest-TestStampPattern-1578819914 None] Lock "cinder-967081aa-1cd4-4e0e-ad3a-7dec928b8e78-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:10 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=27,cinder:UPDATE=18,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:14:10 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=20,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (f97a799d-eeee-4a48-8095-44c718f988ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63beeeb-98ac-4961-8534-efbb5fe65db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63beeeb-98ac-4961-8534-efbb5fe65db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1578438133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ef6fd0-4f5d-4819-9c48-f64629279c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:12Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ecd3c2-8604-4fa0-8b04-f99e2419b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ecd3c2-8604-4fa0-8b04-f99e2419b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea752e7-1b7d-41fa-98d0-7b31817819a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea752e7-1b7d-41fa-98d0-7b31817819a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ef6fd0-4f5d-4819-9c48-f64629279c3d', 'volume_name': 'volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8aa383d-f2e2-46a8-b713-252248ac09e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8aa383d-f2e2-46a8-b713-252248ac09e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d6377c-ed27-44c3-8caf-11344ec0dbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Volume 16ef6fd0-4f5d-4819-9c48-f64629279c3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d', 'volume_size': 1} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1578438133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ef6fd0-4f5d-4819-9c48-f64629279c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:12Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Creating volume 16ef6fd0-4f5d-4819-9c48-f64629279c3d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:12 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:12 devstack sudo[112211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d 1073741824 Aug 26 19:14:12 devstack sudo[112211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (a2472868-e535-4428-98f1-70450dfd72ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fa0a36-56a0-4d99-ac7d-a0e8a658b614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fa0a36-56a0-4d99-ac7d-a0e8a658b614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-574414571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ea1585-a1ca-4f9a-8de7-e3239da1d93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:13Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4469aa1-bab3-49dc-803d-c1ce6a935f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4469aa1-bab3-49dc-803d-c1ce6a935f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852a0faa-fd59-4be9-ad7e-afb8d3be4144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852a0faa-fd59-4be9-ad7e-afb8d3be4144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ea1585-a1ca-4f9a-8de7-e3239da1d93b', 'volume_name': 'volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4448facb-236a-4b10-945b-e9cd75158ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4448facb-236a-4b10-945b-e9cd75158ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3373611-3615-41db-89aa-cc181a1ea9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Volume a3ea1585-a1ca-4f9a-8de7-e3239da1d93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b', 'volume_size': 1} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:12 devstack sudo[112211]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d 1073741824" returned: 0 in 0.571s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:12 devstack sudo[112217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d Aug 26 19:14:12 devstack sudo[112217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (4205b0fa-9614-4ea5-8009-cbcca11c1ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a50e693-2241-424f-8304-4f5b76d6d1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a50e693-2241-424f-8304-4f5b76d6d1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-580745580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff08c8ea-2750-4149-bbcd-9787a1f437e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:13Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8365f3c-d58b-4e20-9e25-9dba0cc7e896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8365f3c-d58b-4e20-9e25-9dba0cc7e896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a30ac8-ff57-41dd-a6ce-97a73bcdaa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a30ac8-ff57-41dd-a6ce-97a73bcdaa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff08c8ea-2750-4149-bbcd-9787a1f437e6', 'volume_name': 'volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f881630-cdb2-4a18-861c-5b1cdd8c396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f881630-cdb2-4a18-861c-5b1cdd8c396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32461010-c1b9-4801-84f6-4866a60db82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:12 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Volume ff08c8ea-2750-4149-bbcd-9787a1f437e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6', 'volume_size': 1} Aug 26 19:14:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:13 devstack sudo[112217]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d" returned: 0 in 0.286s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-574414571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ea1585-a1ca-4f9a-8de7-e3239da1d93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:13Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Creating volume a3ea1585-a1ca-4f9a-8de7-e3239da1d93b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:13 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d6377c-ed27-44c3-8caf-11344ec0dbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c654f0-9754-48f7-ba6b-0540ad7d8f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack sudo[112220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b 1073741824 Aug 26 19:14:13 devstack sudo[112220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Volume volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d (16ef6fd0-4f5d-4819-9c48-f64629279c3d): created successfully Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c654f0-9754-48f7-ba6b-0540ad7d8f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (f97a799d-eeee-4a48-8095-44c718f988ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2641159f-e168-4b6e-b340-98f843c8c1f3 tempest-CreateVolumesFromImageTest-149001493 None] Created volume successfully. Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (d510b772-991d-4536-b94c-1460224e0171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809d4d2f-18fa-482c-925f-255b757799d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809d4d2f-18fa-482c-925f-255b757799d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617902481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:13Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d1abf9-b6d1-4082-afbc-f3998c92ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d1abf9-b6d1-4082-afbc-f3998c92ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a219bb-ed11-46e5-9142-c932d0ad8050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a219bb-ed11-46e5-9142-c932d0ad8050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a', 'volume_name': 'volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcbe1fd-34fa-48fc-87fa-16e3f5cb555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbcbe1fd-34fa-48fc-87fa-16e3f5cb555e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2196dd-cdff-4880-bc78-1626f93abfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Volume 312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a', 'volume_size': 1} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:13 devstack sudo[112220]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b 1073741824" returned: 0 in 0.562s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (8e621b95-8d93-4782-8ca9-db67a66ccc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c3e3ae-3f3c-4a51-9f0e-9fb32578998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c3e3ae-3f3c-4a51-9f0e-9fb32578998c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1057461551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:14Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5832b528-b929-4ed2-b6e9-8a90aa85ae13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5832b528-b929-4ed2-b6e9-8a90aa85ae13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ec9962-54fe-4cc5-9c10-2d3d31a8a598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ec9962-54fe-4cc5-9c10-2d3d31a8a598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6', 'volume_name': 'volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5912dd1-fb3a-4289-9ce6-67a71a2bbf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5912dd1-fb3a-4289-9ce6-67a71a2bbf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c4596d-79eb-4f7b-89d6-a66f3d3de12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Volume 0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6', 'volume_size': 1} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:13 devstack sudo[112226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b Aug 26 19:14:13 devstack sudo[112226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:14 devstack sudo[112226]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b" returned: 0 in 0.254s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.088s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-580745580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff08c8ea-2750-4149-bbcd-9787a1f437e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:13Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Creating volume ff08c8ea-2750-4149-bbcd-9787a1f437e6 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:14 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3373611-3615-41db-89aa-cc181a1ea9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:14 devstack sudo[112229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 1073741824 Aug 26 19:14:14 devstack sudo[112229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcca2bf-8e27-46b2-9633-081aac52dcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:14 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Volume volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b (a3ea1585-a1ca-4f9a-8de7-e3239da1d93b): created successfully Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcca2bf-8e27-46b2-9633-081aac52dcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (a2472868-e535-4428-98f1-70450dfd72ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2b14ad6c-fab3-47ae-9d1f-08c15a7d6272 tempest-CreateVolumesFromImageTest-149001493 None] Created volume successfully. Aug 26 19:14:14 devstack sudo[112229]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 1073741824" returned: 0 in 0.397s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:14 devstack sudo[112234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 Aug 26 19:14:14 devstack sudo[112234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:14 devstack sudo[112234]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6" returned: 0 in 0.251s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1617902481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:13Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Creating volume 312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:14 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32461010-c1b9-4801-84f6-4866a60db82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:14 devstack sudo[112237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a 1073741824 Aug 26 19:14:14 devstack sudo[112237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445be5b6-c9bc-4b31-b2d8-a2800b0dd8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:14 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Volume volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 (ff08c8ea-2750-4149-bbcd-9787a1f437e6): created successfully Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445be5b6-c9bc-4b31-b2d8-a2800b0dd8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:14 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (4205b0fa-9614-4ea5-8009-cbcca11c1ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f28f5000-2732-4332-9bf4-0e73d698fbba tempest-CreateVolumesFromImageTest-149001493 None] Created volume successfully. Aug 26 19:14:15 devstack sudo[112237]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a 1073741824" returned: 0 in 0.414s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:15 devstack sudo[112243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a Aug 26 19:14:15 devstack sudo[112243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:15 devstack sudo[112243]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a" returned: 0 in 0.239s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1057461551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1fc6c3390b41019088766825453bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:14Z,use_quota=True,user_id='61cab448ed824b6c93228c99cf2ec342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Creating volume 0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:15 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2196dd-cdff-4880-bc78-1626f93abfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:15 devstack sudo[112246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 1073741824 Aug 26 19:14:15 devstack sudo[112246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae394b1-c915-44fc-86be-c74f2213326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:15 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Volume volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a (312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a): created successfully Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae394b1-c915-44fc-86be-c74f2213326b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (d510b772-991d-4536-b94c-1460224e0171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-99028191-5564-4f4c-a18a-ebd1bad01e7d tempest-CreateVolumesFromImageTest-149001493 None] Created volume successfully. Aug 26 19:14:15 devstack sudo[112246]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 1073741824" returned: 0 in 0.451s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:15 devstack sudo[112252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 Aug 26 19:14:15 devstack sudo[112252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:16 devstack sudo[112252]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6" returned: 0 in 0.252s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c4596d-79eb-4f7b-89d6-a66f3d3de12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61162460-ebab-4631-904e-0f5cd7e9c94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:16 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Volume volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 (0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6): created successfully Aug 26 19:14:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61162460-ebab-4631-904e-0f5cd7e9c94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Flow 'volume_create_manager' (8e621b95-8d93-4782-8ca9-db67a66ccc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:16 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-dea5b708-0d2b-4964-b353-c00091d63099 tempest-CreateVolumesFromImageTest-149001493 None] Created volume successfully. Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-quobyte-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6" acquired by "delete_volume" :: waited 0.012s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c1d1af-09d9-4306-bbc3-5f1a1733dc14]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:17 devstack sudo[112255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 Aug 26 19:14:17 devstack sudo[112255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:17 devstack sudo[112255]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6" returned: 0 in 0.363s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:17 devstack sudo[112261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6 Aug 26 19:14:17 devstack sudo[112261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:17 devstack sudo[112261]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6" returned: 0 in 0.238s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6" released by "delete_volume" :: held 0.638s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Created reservations ['79d4697f-280f-49bf-b358-d3600314fb8a', '17b002ca-c37e-4aac-9175-454f8822124c', 'c982e766-8dd9-41bc-b058-8208b3a3832b', '8affb803-d825-48eb-9a50-0481e5bbb751'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:17 devstack sudo[112264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:17 devstack sudo[112264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:18 devstack sudo[112264]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.242s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:18 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Deleted volume successfully. Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-238d03bf-7c6a-4b29-80a1-a0104c062e1a tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-0e87a6b9-eeff-49b2-9b59-7a1e5e22d3a6-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-quobyte-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a" acquired by "delete_volume" :: waited 0.013s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef98c828-ffca-4903-904b-a2eff8de68b6]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:18 devstack sudo[112267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a Aug 26 19:14:18 devstack sudo[112267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:18 devstack sudo[112267]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a" returned: 0 in 0.382s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:18 devstack sudo[112272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a Aug 26 19:14:18 devstack sudo[112272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:18 devstack sudo[112272]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a" returned: 0 in 0.230s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a" released by "delete_volume" :: held 0.650s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Created reservations ['585c8aee-7328-401d-9431-2adbdb764a8c', 'd8a3a39c-77d7-40cc-8f41-e1784a38f742', 'a258946f-c2b2-445c-8e6b-8c0bd50e3340', 'b67de8ee-1d3f-498c-b66d-5c96cea985be'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:19 devstack sudo[112275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:19 devstack sudo[112275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:19 devstack sudo[112275]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.242s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Deleted volume successfully. Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7895bb25-2976-4ff7-b77e-5348213874dd tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-312e02b6-4c6f-4d3e-8a93-8fc2aa4f444a-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-ff08c8ea-2750-4149-bbcd-9787a1f437e6-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-ff08c8ea-2750-4149-bbcd-9787a1f437e6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-quobyte-ff08c8ea-2750-4149-bbcd-9787a1f437e6" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-ff08c8ea-2750-4149-bbcd-9787a1f437e6" acquired by "delete_volume" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba3daa4-ce8d-4b3c-8bd3-062a7e5ecb53]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:19 devstack sudo[112278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 Aug 26 19:14:19 devstack sudo[112278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:19 devstack sudo[112278]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6" returned: 0 in 0.383s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:19 devstack sudo[112284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6 Aug 26 19:14:19 devstack sudo[112284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:20 devstack sudo[112284]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-ff08c8ea-2750-4149-bbcd-9787a1f437e6" returned: 0 in 0.231s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-ff08c8ea-2750-4149-bbcd-9787a1f437e6" released by "delete_volume" :: held 0.650s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Created reservations ['40ce54de-4c70-4d36-8467-1c749105b2de', 'a11be29f-1d3c-4924-8036-a9ff20d06549', '19c99efa-8c1c-4dc7-a3fd-61e538231e13', '47ba7fca-4df5-4078-b0a2-1dcc9de2c58e'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:20 devstack sudo[112287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:20 devstack sudo[112287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:20 devstack sudo[112287]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.253s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:20 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Deleted volume successfully. Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3dcbf558-4ae5-4ad1-a599-7860ce50d309 tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-ff08c8ea-2750-4149-bbcd-9787a1f437e6-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-quobyte-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b" acquired by "delete_volume" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eced5d4-26e4-43e3-81ad-56df6af0d732]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:20 devstack sudo[112290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b Aug 26 19:14:20 devstack sudo[112290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:21 devstack sudo[112290]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b" returned: 0 in 0.349s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:21 devstack sudo[112295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b Aug 26 19:14:21 devstack sudo[112295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:21 devstack sudo[112295]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b" returned: 0 in 0.233s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b" released by "delete_volume" :: held 0.621s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Created reservations ['c4e19f50-b20f-42f9-b348-1f0ae151f6e7', '57b2e1b5-6d10-404d-af01-a794e2c2378a', 'd97c5f14-067a-4c6f-9aa9-fc4d0a04b80a', 'e48f9219-ee8b-46dc-a970-084bbe6f92e2'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:21 devstack sudo[112298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:21 devstack sudo[112298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-16ef6fd0-4f5d-4819-9c48-f64629279c3d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-16ef6fd0-4f5d-4819-9c48-f64629279c3d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "cinder-quobyte-16ef6fd0-4f5d-4819-9c48-f64629279c3d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-16ef6fd0-4f5d-4819-9c48-f64629279c3d" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da56e47-e698-45b1-ad4e-56fbc4b09e93]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:21 devstack sudo[112298]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Deleted volume successfully. Aug 26 19:14:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f714ba20-bdff-4c19-9daa-505bdbd25c9d tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-a3ea1585-a1ca-4f9a-8de7-e3239da1d93b-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:22 devstack sudo[112301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d Aug 26 19:14:22 devstack sudo[112301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:22 devstack sudo[112301]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d" returned: 0 in 0.385s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:22 devstack sudo[112306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d Aug 26 19:14:22 devstack sudo[112306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:22 devstack sudo[112306]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-16ef6fd0-4f5d-4819-9c48-f64629279c3d" returned: 0 in 0.249s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-quobyte-16ef6fd0-4f5d-4819-9c48-f64629279c3d" released by "delete_volume" :: held 0.673s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Created reservations ['1aa5e4fe-c4c1-43a1-8d73-670b55fefc89', '9d8a0606-7603-4446-b420-d542afb8a553', '6dd59562-2cb2-4b98-b31b-bbd3f8b41742', '4cda9ae9-836b-47ec-ab0f-5072c466c1c6'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:22 devstack sudo[112309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:22 devstack sudo[112309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:22 devstack sudo[112309]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.259s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:22 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Deleted volume successfully. Aug 26 19:14:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-eab8f58b-27ea-4473-9e64-4e490f518dc6 tempest-CreateVolumesFromImageTest-149001493 None] Lock "cinder-16ef6fd0-4f5d-4819-9c48-f64629279c3d-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (a9f6c2d0-402a-4dc1-962c-512a8819c113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de38954-811a-4ada-b677-bf6b2d57791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de38954-811a-4ada-b677-bf6b2d57791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549614888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485ba0bd-4127-42be-bc62-879648d4a913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:26Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd840908-df6a-41c8-ab1a-614f775ac5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd840908-df6a-41c8-ab1a-614f775ac5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c751b3b6-56f8-4f18-bb06-a7178a69d278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c751b3b6-56f8-4f18-bb06-a7178a69d278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485ba0bd-4127-42be-bc62-879648d4a913', 'volume_name': 'volume-485ba0bd-4127-42be-bc62-879648d4a913', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a9e86e-0d9f-4dd4-8b93-3fd07f4e412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a9e86e-0d9f-4dd4-8b93-3fd07f4e412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba743f9-ee28-44db-962c-e2c2486154f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:25 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume 485ba0bd-4127-42be-bc62-879648d4a913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485ba0bd-4127-42be-bc62-879648d4a913', 'volume_size': 1} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549614888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485ba0bd-4127-42be-bc62-879648d4a913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:26Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Creating volume 485ba0bd-4127-42be-bc62-879648d4a913 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:25 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:25 devstack sudo[112312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 1073741824 Aug 26 19:14:25 devstack sudo[112312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:26 devstack sudo[112312]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 1073741824" returned: 0 in 0.434s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:26 devstack sudo[112318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 Aug 26 19:14:26 devstack sudo[112318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:26 devstack sudo[112318]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913" returned: 0 in 0.243s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba743f9-ee28-44db-962c-e2c2486154f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485ba0bd-4127-42be-bc62-879648d4a913', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9948f2-f0fd-466b-8b4c-70cd14ff275f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:26 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume volume-485ba0bd-4127-42be-bc62-879648d4a913 (485ba0bd-4127-42be-bc62-879648d4a913): created successfully Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9948f2-f0fd-466b-8b4c-70cd14ff275f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (a9f6c2d0-402a-4dc1-962c-512a8819c113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2a9673f9-e789-47c1-a5cc-b5995e309497 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created volume successfully. Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Creating offline snapshot 11f79cfa-3b2a-4a0c-b660-0905c2a06037 of volume 485ba0bd-4127-42be-bc62-879648d4a913 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b9390-6fdc-4abd-9e4f-7caea372b274]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:27 devstack sudo[112321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 Aug 26 19:14:27 devstack sudo[112321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:27 devstack sudo[112321]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913" returned: 0 in 0.364s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:27 devstack sudo[112326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 1G Aug 26 19:14:27 devstack sudo[112326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:27 devstack sudo[112326]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 1G" returned: 0 in 0.404s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-485ba0bd-4127-42be-bc62-879648d4a913 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:27 devstack sudo[112333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-485ba0bd-4127-42be-bc62-879648d4a913 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 Aug 26 19:14:27 devstack sudo[112333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:28 devstack sudo[112333]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-485ba0bd-4127-42be-bc62-879648d4a913 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037" returned: 0 in 0.336s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:28 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 is being set with open permissions: ugo+rw Aug 26 19:14:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:28 devstack sudo[112338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 Aug 26 19:14:28 devstack sudo[112338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:28 devstack sudo[112338]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037" returned: 0 in 0.258s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:28 devstack sudo[112341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.info Aug 26 19:14:28 devstack sudo[112341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:28 devstack sudo[112341]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.info" returned: 0 in 0.266s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:28 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.info is being set with open permissions: ugo+rw Aug 26 19:14:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:28 devstack sudo[112344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.info Aug 26 19:14:28 devstack sudo[112344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:28 devstack sudo[112344]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.info" returned: 0 in 0.258s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-679e4568-09b6-4688-810e-7b672cd8637a tempest-CreateVolumesFromSnapshotTest-1635109840 None] Create snapshot completed successfully Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (116c2299-d422-4a02-b181-fd4397bbe90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc98d87a-b399-4e6e-9333-4718e293d67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc98d87a-b399-4e6e-9333-4718e293d67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650312413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59826c14-e848-4286-8b00-385aef78fa6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:29Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6402606c-2afb-4e02-afef-42a8851cc467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6402606c-2afb-4e02-afef-42a8851cc467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e6af63-c48c-45f6-a1f2-cc3dd23ebd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e6af63-c48c-45f6-a1f2-cc3dd23ebd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59826c14-e848-4286-8b00-385aef78fa6d', 'volume_name': 'volume-59826c14-e848-4286-8b00-385aef78fa6d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b7beb1-5464-4958-a702-62e269f93db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b7beb1-5464-4958-a702-62e269f93db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae7e11d-ec77-4515-8f68-50f49f1d48f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume 59826c14-e848-4286-8b00-385aef78fa6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59826c14-e848-4286-8b00-385aef78fa6d', 'volume_size': 1} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650312413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59826c14-e848-4286-8b00-385aef78fa6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:29Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Creating volume 59826c14-e848-4286-8b00-385aef78fa6d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:29 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:29 devstack sudo[112347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d 1073741824 Aug 26 19:14:29 devstack sudo[112347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (c9dd07d7-4aa4-42d2-a090-09ae1f9f39b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374793bd-06f1-4720-9999-9c22536b92e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374793bd-06f1-4720-9999-9c22536b92e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1539088072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a91ae7-b34f-47fb-8467-fda503abbec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:30Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bc409e-17aa-48d8-bd6b-fcad411c6d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bc409e-17aa-48d8-bd6b-fcad411c6d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ef513f-3e66-4851-b36b-f8c1aca4cedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ef513f-3e66-4851-b36b-f8c1aca4cedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a91ae7-b34f-47fb-8467-fda503abbec0', 'volume_name': 'volume-75a91ae7-b34f-47fb-8467-fda503abbec0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1346806b-8b9d-4a97-b2b4-47b89901da46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1346806b-8b9d-4a97-b2b4-47b89901da46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3584b83-0c45-4aa2-b2eb-c8876f7f14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:29 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume 75a91ae7-b34f-47fb-8467-fda503abbec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a91ae7-b34f-47fb-8467-fda503abbec0', 'volume_size': 1} Aug 26 19:14:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:30 devstack sudo[112347]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d 1073741824" returned: 0 in 0.537s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:30 devstack sudo[112353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d Aug 26 19:14:30 devstack sudo[112353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (da08e0e0-efc5-4314-ae3b-6df4367fdc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaa4aa2-c62f-4816-89e7-b20d7a6cc3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaa4aa2-c62f-4816-89e7-b20d7a6cc3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559195167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5467cac3-9b67-4394-87b7-41e573fcbbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:30Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d113b75c-9a5b-41eb-8214-06fb2b89e15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d113b75c-9a5b-41eb-8214-06fb2b89e15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14b349d-4da7-4e5e-b5dd-7b8342ee43d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14b349d-4da7-4e5e-b5dd-7b8342ee43d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5467cac3-9b67-4394-87b7-41e573fcbbf6', 'volume_name': 'volume-5467cac3-9b67-4394-87b7-41e573fcbbf6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bec61d-7be2-4f5e-b126-70cd594759fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bec61d-7be2-4f5e-b126-70cd594759fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eab1b05-b3ad-4037-83d6-fb3f09440f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume 5467cac3-9b67-4394-87b7-41e573fcbbf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5467cac3-9b67-4394-87b7-41e573fcbbf6', 'volume_size': 1} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:30 devstack sudo[112353]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d" returned: 0 in 0.307s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1539088072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a91ae7-b34f-47fb-8467-fda503abbec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:30Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Creating volume 75a91ae7-b34f-47fb-8467-fda503abbec0 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:30 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae7e11d-ec77-4515-8f68-50f49f1d48f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59826c14-e848-4286-8b00-385aef78fa6d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack sudo[112356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0 1073741824 Aug 26 19:14:30 devstack sudo[112356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd04dea5-dabd-4c7a-a840-abe3d2d12506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume volume-59826c14-e848-4286-8b00-385aef78fa6d (59826c14-e848-4286-8b00-385aef78fa6d): created successfully Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd04dea5-dabd-4c7a-a840-abe3d2d12506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (116c2299-d422-4a02-b181-fd4397bbe90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-476c34e6-a802-441d-9217-ac75c01ea7f1 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created volume successfully. Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (d1648775-cd7e-407c-a05a-a1eb435c8c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844c8a4a-4810-4b36-a439-827aaea6138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844c8a4a-4810-4b36-a439-827aaea6138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894741224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c422cec6-f05a-40e0-873e-a54a73b340d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:30Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96427bf-0a4d-4d5a-bc32-c17f30bc94e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b96427bf-0a4d-4d5a-bc32-c17f30bc94e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d35c273-a506-47aa-bfea-2d7d89f9e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d35c273-a506-47aa-bfea-2d7d89f9e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c422cec6-f05a-40e0-873e-a54a73b340d5', 'volume_name': 'volume-c422cec6-f05a-40e0-873e-a54a73b340d5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62817d7a-6cf2-4b54-9538-4b578b05b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62817d7a-6cf2-4b54-9538-4b578b05b24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00915e6a-9d29-4d44-9179-b04a97779456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:30 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume c422cec6-f05a-40e0-873e-a54a73b340d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c422cec6-f05a-40e0-873e-a54a73b340d5', 'volume_size': 1} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:30 devstack sudo[112356]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0 1073741824" returned: 0 in 0.476s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:30 devstack sudo[112362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0 Aug 26 19:14:30 devstack sudo[112362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (5ee5fd6a-360e-4fe2-86de-1fa360ebee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94e9f8d-be09-4743-abc2-cd6b07183179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94e9f8d-be09-4743-abc2-cd6b07183179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468119000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feabce0-dcfa-459e-8d13-aa9c03a12b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:31Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3b2180-935b-40d5-914e-9fef36adb1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3b2180-935b-40d5-914e-9fef36adb1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80c6a91-9570-4ba3-a80c-83dc5e540dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80c6a91-9570-4ba3-a80c-83dc5e540dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3feabce0-dcfa-459e-8d13-aa9c03a12b56', 'volume_name': 'volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8bc5e6-7063-44f1-b9ff-f63f86cf3550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8bc5e6-7063-44f1-b9ff-f63f86cf3550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d5d7cf-04ed-4a7c-b40b-ad60a9b78a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume 3feabce0-dcfa-459e-8d13-aa9c03a12b56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56', 'volume_size': 1} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:31 devstack sudo[112362]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0" returned: 0 in 0.249s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559195167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5467cac3-9b67-4394-87b7-41e573fcbbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:30Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Creating volume 5467cac3-9b67-4394-87b7-41e573fcbbf6 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:31 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3584b83-0c45-4aa2-b2eb-c8876f7f14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a91ae7-b34f-47fb-8467-fda503abbec0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e0b6c0-799e-4a3b-811d-16f7974f8c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:31 devstack sudo[112365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 1073741824 Aug 26 19:14:31 devstack sudo[112365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume volume-75a91ae7-b34f-47fb-8467-fda503abbec0 (75a91ae7-b34f-47fb-8467-fda503abbec0): created successfully Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e0b6c0-799e-4a3b-811d-16f7974f8c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (c9dd07d7-4aa4-42d2-a090-09ae1f9f39b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ac562d2e-db45-4962-a31c-5f0ce2d00749 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created volume successfully. Aug 26 19:14:31 devstack sudo[112365]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 1073741824" returned: 0 in 0.434s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:31 devstack sudo[112371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 Aug 26 19:14:31 devstack sudo[112371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:31 devstack sudo[112371]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6" returned: 0 in 0.269s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894741224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c422cec6-f05a-40e0-873e-a54a73b340d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:30Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Creating volume c422cec6-f05a-40e0-873e-a54a73b340d5 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:31 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eab1b05-b3ad-4037-83d6-fb3f09440f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5467cac3-9b67-4394-87b7-41e573fcbbf6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44de8589-48f3-4778-a701-b80ddeed2a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:31 devstack sudo[112374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5 1073741824 Aug 26 19:14:31 devstack sudo[112374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:32 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 (5467cac3-9b67-4394-87b7-41e573fcbbf6): created successfully Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44de8589-48f3-4778-a701-b80ddeed2a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (da08e0e0-efc5-4314-ae3b-6df4367fdc3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f5caf666-2ab2-4ebe-b516-20bb0c983797 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created volume successfully. Aug 26 19:14:32 devstack sudo[112374]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5 1073741824" returned: 0 in 0.451s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:32 devstack sudo[112379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5 Aug 26 19:14:32 devstack sudo[112379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:32 devstack sudo[112379]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5" returned: 0 in 0.243s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.611s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1468119000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feabce0-dcfa-459e-8d13-aa9c03a12b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3a6d46ff7493eadfca20fef841b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:31Z,use_quota=True,user_id='34ebb82dba9c4e3cae99cd25de9c0d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Creating volume 3feabce0-dcfa-459e-8d13-aa9c03a12b56 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:32 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00915e6a-9d29-4d44-9179-b04a97779456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c422cec6-f05a-40e0-873e-a54a73b340d5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:32 devstack sudo[112382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 1073741824 Aug 26 19:14:32 devstack sudo[112382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a310c36c-e92b-4862-9b5d-e1ecbf8929c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:32 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume volume-c422cec6-f05a-40e0-873e-a54a73b340d5 (c422cec6-f05a-40e0-873e-a54a73b340d5): created successfully Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a310c36c-e92b-4862-9b5d-e1ecbf8929c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (d1648775-cd7e-407c-a05a-a1eb435c8c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ba264ac7-532f-4e90-a5f4-18191da8bd93 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created volume successfully. Aug 26 19:14:33 devstack sudo[112382]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 1073741824" returned: 0 in 0.502s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:33 devstack sudo[112388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 Aug 26 19:14:33 devstack sudo[112388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:33 devstack sudo[112388]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56" returned: 0 in 0.261s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d5d7cf-04ed-4a7c-b40b-ad60a9b78a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9854bd7-85e4-47b9-8a38-53c64ca5207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Volume volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 (3feabce0-dcfa-459e-8d13-aa9c03a12b56): created successfully Aug 26 19:14:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9854bd7-85e4-47b9-8a38-53c64ca5207f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Flow 'volume_create_manager' (5ee5fd6a-360e-4fe2-86de-1fa360ebee96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ca65ec79-7708-4990-a48d-03bab45bb997 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created volume successfully. Aug 26 19:14:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-3feabce0-dcfa-459e-8d13-aa9c03a12b56-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-3feabce0-dcfa-459e-8d13-aa9c03a12b56-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-quobyte-3feabce0-dcfa-459e-8d13-aa9c03a12b56" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-3feabce0-dcfa-459e-8d13-aa9c03a12b56" acquired by "delete_volume" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:34 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[334341c6-0bc4-4bdd-9dbd-d564a399cdb9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:34 devstack sudo[112391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 Aug 26 19:14:34 devstack sudo[112391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:34 devstack sudo[112391]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56" returned: 0 in 0.374s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:34 devstack sudo[112396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56 Aug 26 19:14:34 devstack sudo[112396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:35 devstack sudo[112396]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3feabce0-dcfa-459e-8d13-aa9c03a12b56" returned: 0 in 0.267s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-3feabce0-dcfa-459e-8d13-aa9c03a12b56" released by "delete_volume" :: held 0.679s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created reservations ['68022816-dc0a-4cd4-b28b-924a331addf5', 'af6d2710-b5d7-40a2-bbb4-e100513dd039', 'badea84f-e56a-4017-9869-18cbadb19d25', '6471365e-b1eb-4760-8c84-ecccf2cfe8ac'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:35 devstack sudo[112399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:35 devstack sudo[112399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:35 devstack sudo[112399]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.254s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Deleted volume successfully. Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c509e49e-a817-4a8c-a065-6beda58259b6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-3feabce0-dcfa-459e-8d13-aa9c03a12b56-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-c422cec6-f05a-40e0-873e-a54a73b340d5-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-c422cec6-f05a-40e0-873e-a54a73b340d5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-quobyte-c422cec6-f05a-40e0-873e-a54a73b340d5" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-c422cec6-f05a-40e0-873e-a54a73b340d5" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[98103ceb-6aa3-4802-8234-27f8ddd213f7]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:35 devstack sudo[112402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5 Aug 26 19:14:35 devstack sudo[112402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:36 devstack sudo[112402]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5" returned: 0 in 0.403s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:36 devstack sudo[112407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5 Aug 26 19:14:36 devstack sudo[112407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:36 devstack sudo[112407]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c422cec6-f05a-40e0-873e-a54a73b340d5" returned: 0 in 0.244s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-c422cec6-f05a-40e0-873e-a54a73b340d5" released by "delete_volume" :: held 0.685s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created reservations ['a781e0a0-c9d4-44fc-b5c7-3b642937d84d', 'ff064378-23d4-4741-8028-b7161488f0fa', 'eef6dcb9-cb33-48fa-bb2c-aa0136a49d48', 'e1a55ae8-0a44-4125-9a0d-fcd2031aed60'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:36 devstack sudo[112410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:36 devstack sudo[112410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:36 devstack sudo[112410]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.245s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:36 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Deleted volume successfully. Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d05d5fc4-7f9d-4694-aa56-e784ddfebeda tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-c422cec6-f05a-40e0-873e-a54a73b340d5-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-5467cac3-9b67-4394-87b7-41e573fcbbf6-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-5467cac3-9b67-4394-87b7-41e573fcbbf6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-quobyte-5467cac3-9b67-4394-87b7-41e573fcbbf6" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-5467cac3-9b67-4394-87b7-41e573fcbbf6" acquired by "delete_volume" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fe9131-da8e-4274-982e-f55bbed07a49]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:36 devstack sudo[112413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 Aug 26 19:14:36 devstack sudo[112413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:37 devstack sudo[112413]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6" returned: 0 in 0.356s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:37 devstack sudo[112418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6 Aug 26 19:14:37 devstack sudo[112418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:37 devstack sudo[112418]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5467cac3-9b67-4394-87b7-41e573fcbbf6" returned: 0 in 0.248s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-5467cac3-9b67-4394-87b7-41e573fcbbf6" released by "delete_volume" :: held 0.644s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created reservations ['1eb5867c-a20c-4356-bd2d-1d36b1a46893', '85e59f41-2f78-4f8b-910e-75a2250b0f11', '97a68d1e-e909-4635-96eb-b2444d4779fb', '4a7b20ec-a180-4836-8050-304025690497'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:37 devstack sudo[112422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:37 devstack sudo[112422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:37 devstack sudo[112422]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.251s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:37 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Deleted volume successfully. Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-e6e73415-283e-479b-890e-9028257d136f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-5467cac3-9b67-4394-87b7-41e573fcbbf6-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-75a91ae7-b34f-47fb-8467-fda503abbec0-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-75a91ae7-b34f-47fb-8467-fda503abbec0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-quobyte-75a91ae7-b34f-47fb-8467-fda503abbec0" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-75a91ae7-b34f-47fb-8467-fda503abbec0" acquired by "delete_volume" :: waited 0.014s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1655b-b4fc-4592-b06d-82fe0e514863]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:38 devstack sudo[112425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0 Aug 26 19:14:38 devstack sudo[112425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:38 devstack sudo[112425]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0" returned: 0 in 0.367s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:38 devstack sudo[112430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0 Aug 26 19:14:38 devstack sudo[112430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:38 devstack sudo[112430]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-75a91ae7-b34f-47fb-8467-fda503abbec0" returned: 0 in 0.263s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-75a91ae7-b34f-47fb-8467-fda503abbec0" released by "delete_volume" :: held 0.669s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created reservations ['7947a1c6-a2d8-40dd-9b34-13886e7b39d2', '36e664f0-7620-4d29-b4cb-07b0c06938ad', '754226a2-dd5e-41df-a06b-0ad2cb2e5e9e', '5dc52e8f-b9a0-48c7-af0e-9c3506da0d84'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:38 devstack sudo[112433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:38 devstack sudo[112433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:39 devstack sudo[112433]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.256s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:39 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Deleted volume successfully. Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-255dfc9c-751c-4cfc-9382-ac6ae75e6cb6 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-75a91ae7-b34f-47fb-8467-fda503abbec0-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-59826c14-e848-4286-8b00-385aef78fa6d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-59826c14-e848-4286-8b00-385aef78fa6d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-quobyte-59826c14-e848-4286-8b00-385aef78fa6d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-59826c14-e848-4286-8b00-385aef78fa6d" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d505149-1759-4167-91eb-5ad9a24c45bc]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:39 devstack sudo[112470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d Aug 26 19:14:39 devstack sudo[112470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:39 devstack sudo[112470]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d" returned: 0 in 0.354s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:39 devstack sudo[112477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d Aug 26 19:14:39 devstack sudo[112477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:39 devstack sudo[112477]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-59826c14-e848-4286-8b00-385aef78fa6d" returned: 0 in 0.269s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-59826c14-e848-4286-8b00-385aef78fa6d" released by "delete_volume" :: held 0.660s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created reservations ['c6a31940-c768-42b1-b188-21c169afad06', '03a57d66-2fec-4948-bee9-9687723e902f', 'a1791c54-5005-4d02-b6a6-31bf087aea55', '4fabbe2a-53ac-4391-9cce-d92361f398bc'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:39 devstack sudo[112480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:39 devstack sudo[112480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:40 devstack sudo[112480]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.232s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Deleted volume successfully. Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a1d8b47c-0fab-450c-a8b0-9550f172a050 tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-59826c14-e848-4286-8b00-385aef78fa6d-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-11f79cfa-3b2a-4a0c-b660-0905c2a06037-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-11f79cfa-3b2a-4a0c-b660-0905c2a06037-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-quobyte-485ba0bd-4127-42be-bc62-879648d4a913" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-485ba0bd-4127-42be-bc62-879648d4a913" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-quobyte-11f79cfa-3b2a-4a0c-b660-0905c2a06037" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-11f79cfa-3b2a-4a0c-b660-0905c2a06037" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Deleting offline snapshot 11f79cfa-3b2a-4a0c-b660-0905c2a06037 of volume 485ba0bd-4127-42be-bc62-879648d4a913 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] snapshot_file for this snap is: volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7f0b1d-6175-4387-82c6-176b49729479]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:40 devstack sudo[112483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 Aug 26 19:14:40 devstack sudo[112483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:40 devstack sudo[112483]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037" returned: 0 in 0.344s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-485ba0bd-4127-42be-bc62-879648d4a913(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[741773d4-d228-4896-8d33-fae7b56a8128]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:40 devstack sudo[112488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 Aug 26 19:14:40 devstack sudo[112488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:41 devstack sudo[112488]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913" returned: 0 in 0.351s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:41 devstack sudo[112493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 Aug 26 19:14:41 devstack sudo[112493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:41 devstack sudo[112493]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:41 devstack sudo[112498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037 Aug 26 19:14:41 devstack sudo[112498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:41 devstack sudo[112498]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913.11f79cfa-3b2a-4a0c-b660-0905c2a06037" returned: 0 in 0.240s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-11f79cfa-3b2a-4a0c-b660-0905c2a06037" released by "_delete_snapshot" :: held 1.379s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-485ba0bd-4127-42be-bc62-879648d4a913" released by "delete_snapshot" :: held 1.401s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:41 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created reservations ['95e152b4-59ca-4b06-9eed-ee71507521a3', '420454f7-862d-4b9b-b7f5-c76f0ad42b2a', 'c7cca884-bfb0-42bd-9e47-783e27f31006', 'ac67a158-6294-40e9-a03d-8e0deb84d019'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Delete snapshot completed successfully. Aug 26 19:14:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2ebd492-16bd-492a-97ad-dd1a135e0b5e tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-11f79cfa-3b2a-4a0c-b660-0905c2a06037-delete_snapshot" released by "delete_snapshot" :: held 1.543s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-485ba0bd-4127-42be-bc62-879648d4a913-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-485ba0bd-4127-42be-bc62-879648d4a913-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "cinder-quobyte-485ba0bd-4127-42be-bc62-879648d4a913" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-485ba0bd-4127-42be-bc62-879648d4a913" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:42 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[407c9ce8-2c8c-4ee8-a7e8-b22fb1b36db2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:42 devstack sudo[112501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 Aug 26 19:14:42 devstack sudo[112501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:42 devstack sudo[112501]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913" returned: 0 in 0.365s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:42 devstack sudo[112506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913 Aug 26 19:14:42 devstack sudo[112506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:43 devstack sudo[112506]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-485ba0bd-4127-42be-bc62-879648d4a913" returned: 0 in 0.258s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-quobyte-485ba0bd-4127-42be-bc62-879648d4a913" released by "delete_volume" :: held 0.684s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Created reservations ['5976d1b8-f28b-4734-9e8f-795c2cb8f81a', '8d9a974d-fe31-41f0-849c-62192f4d80a2', '50b507bf-43d1-42bd-9280-eaeaff827700', '64fe26e8-8ad9-4c71-bd77-56748f40f816'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:43 devstack sudo[112509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:43 devstack sudo[112509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:43 devstack sudo[112509]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.249s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:43 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Deleted volume successfully. Aug 26 19:14:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-70ae4b95-56c2-429d-bbb6-227c0366655f tempest-CreateVolumesFromSnapshotTest-1635109840 None] Lock "cinder-485ba0bd-4127-42be-bc62-879648d4a913-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Flow 'volume_create_manager' (955aca77-e8d6-4ab2-a19a-8ffa2dcccf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dde060-4cf8-4f50-ac06-158f0a5fb621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dde060-4cf8-4f50-ac06-158f0a5fb621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b89d215-5d16-418b-8772-c5aa563729a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972974576915442eacbdce059a108213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:48Z,use_quota=True,user_id='1609a52a951449bf987113f6c5a60597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e201c8c-714f-49c9-831e-e4b450d03036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e201c8c-714f-49c9-831e-e4b450d03036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6535568-e471-4da1-93c1-96c7c3d095ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6535568-e471-4da1-93c1-96c7c3d095ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b89d215-5d16-418b-8772-c5aa563729a7', 'volume_name': 'volume-4b89d215-5d16-418b-8772-c5aa563729a7', 'volume_size': 1, 'image_id': 'f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09fbcbb7728a4d555f31d7384e3ad199', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '972974576915442eacbdce059a108213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2c4b577cdb4c006076d5e3a77cb4a534e4c7b9162ebd7042e8df9243b023a5ab8a460625141bf22a0e29c795c27710237b0e8752d5a23a533fbbd5b0826af53', 'id': 'f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'created_at': datetime.datetime(2026, 8, 26, 17, 14, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 14, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f56aa1ea-8893-4692-a3d2-b0d27ad02247/file', 'properties': {}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bb5478-a68a-47da-b4c3-57e066ef7dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bb5478-a68a-47da-b4c3-57e066ef7dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d474438-7eea-4803-bd8e-6f0afe3c12b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:48 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Volume 4b89d215-5d16-418b-8772-c5aa563729a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b89d215-5d16-418b-8772-c5aa563729a7', 'volume_size': 1, 'image_id': 'f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09fbcbb7728a4d555f31d7384e3ad199', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '972974576915442eacbdce059a108213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2c4b577cdb4c006076d5e3a77cb4a534e4c7b9162ebd7042e8df9243b023a5ab8a460625141bf22a0e29c795c27710237b0e8752d5a23a533fbbd5b0826af53', 'id': 'f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'created_at': datetime.datetime(2026, 8, 26, 17, 14, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 14, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f56aa1ea-8893-4692-a3d2-b0d27ad02247/file', 'properties': {}}, 'image_service': } Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Trying to clone 4b89d215-5d16-418b-8772-c5aa563729a7 from image f56aa1ea-8893-4692-a3d2-b0d27ad02247 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 19:14:48 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Image download 0.00 MB at 0.00 MB/s Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[59358455-178d-4983-a751-ae0971d9da11]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:49 devstack sudo[112519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD Aug 26 19:14:49 devstack sudo[112519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:49 devstack sudo[112519]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:49 devstack sudo[112523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD Aug 26 19:14:49 devstack sudo[112523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:49 devstack sudo[112523]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:14:49 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Temporary image f56aa1ea-8893-4692-a3d2-b0d27ad02247 is fetched for user 1609a52a951449bf987113f6c5a60597. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 19:14:49 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad27b348-0e89-46ee-a49e-7bcb36377a5f]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:49 devstack sudo[112528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD Aug 26 19:14:49 devstack sudo[112528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:49 devstack sudo[112528]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:50 devstack sudo[112532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD Aug 26 19:14:50 devstack sudo[112532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:50 devstack sudo[112532]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD" returned: 1 in 0.303s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b89d215-5d16-418b-8772-c5aa563729a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972974576915442eacbdce059a108213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:14:48Z,use_quota=True,user_id='1609a52a951449bf987113f6c5a60597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Creating volume 4b89d215-5d16-418b-8772-c5aa563729a7 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:14:50 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:50 devstack sudo[112537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 1073741824 Aug 26 19:14:50 devstack sudo[112537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:50 devstack sudo[112537]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 1073741824" returned: 0 in 0.400s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:50 devstack sudo[112542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 Aug 26 19:14:50 devstack sudo[112542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:50 devstack sudo[112542]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7" returned: 0 in 0.250s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:50 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Attempting download of f56aa1ea-8893-4692-a3d2-b0d27ad02247 ((None, [{'url': 'file:///opt/stack/data/glance/images/f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'metadata': {}}])) to volume 4b89d215-5d16-418b-8772-c5aa563729a7. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 19:14:51 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2b8e8d-ca75-40d7-8921-5574827241fe]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f56aa1ea-8893-4692-a3d2-b0d27ad02247_bcqmal08 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:51 devstack sudo[112545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f56aa1ea-8893-4692-a3d2-b0d27ad02247_bcqmal08 Aug 26 19:14:51 devstack sudo[112545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:51 devstack sudo[112545]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f56aa1ea-8893-4692-a3d2-b0d27ad02247_bcqmal08" returned: 0 in 0.331s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f56aa1ea-8893-4692-a3d2-b0d27ad02247_bcqmal08 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:51 devstack sudo[112549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f56aa1ea-8893-4692-a3d2-b0d27ad02247_bcqmal08 Aug 26 19:14:51 devstack sudo[112549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:51 devstack sudo[112549]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f56aa1ea-8893-4692-a3d2-b0d27ad02247_bcqmal08" returned: 1 in 0.322s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f56aa1ea-8893-4692-a3d2-b0d27ad02247_bcqmal08' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:14:51 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb3e252-7b9c-4801-adb2-bbb93065f93f]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:51 devstack sudo[112553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD Aug 26 19:14:51 devstack sudo[112553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:52 devstack sudo[112553]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:52 devstack sudo[112557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD Aug 26 19:14:52 devstack sudo[112557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:52 devstack sudo[112557]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD" returned: 1 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:14:52 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] f56aa1ea-8893-4692-a3d2-b0d27ad02247 was raw, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 19:14:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:52 devstack sudo[112562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 Aug 26 19:14:52 devstack sudo[112562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:52 devstack sudo[112562]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7" returned: 0 in 0.428s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:52 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f56aa1ea-8893-4692-a3d2-b0d27ad02247_a5x05b53devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:14:52 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 19:14:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:52 devstack sudo[112568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 1G Aug 26 19:14:52 devstack sudo[112568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:53 devstack sudo[112568]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 1G" returned: 0 in 0.307s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Downloaded image f56aa1ea-8893-4692-a3d2-b0d27ad02247 ((None, [{'url': 'file:///opt/stack/data/glance/images/f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'metadata': {}}])) to volume 4b89d215-5d16-418b-8772-c5aa563729a7 successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Temporary image f56aa1ea-8893-4692-a3d2-b0d27ad02247 for user 1609a52a951449bf987113f6c5a60597 is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Marking volume 4b89d215-5d16-418b-8772-c5aa563729a7 as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Copying metadata from image f56aa1ea-8893-4692-a3d2-b0d27ad02247 to 4b89d215-5d16-418b-8772-c5aa563729a7. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Creating volume glance metadata for volume 4b89d215-5d16-418b-8772-c5aa563729a7 backed by image f56aa1ea-8893-4692-a3d2-b0d27ad02247 with: {'image_id': 'f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '09fbcbb7728a4d555f31d7384e3ad199', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d474438-7eea-4803-bd8e-6f0afe3c12b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b89d215-5d16-418b-8772-c5aa563729a7', 'volume_size': 1, 'image_id': 'f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09fbcbb7728a4d555f31d7384e3ad199', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '972974576915442eacbdce059a108213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2c4b577cdb4c006076d5e3a77cb4a534e4c7b9162ebd7042e8df9243b023a5ab8a460625141bf22a0e29c795c27710237b0e8752d5a23a533fbbd5b0826af53', 'id': 'f56aa1ea-8893-4692-a3d2-b0d27ad02247', 'created_at': datetime.datetime(2026, 8, 26, 17, 14, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 14, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f56aa1ea-8893-4692-a3d2-b0d27ad02247/file', 'properties': {}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8bddbd-fc6f-4df0-b7c7-f6631f59c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:14:53 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Volume volume-4b89d215-5d16-418b-8772-c5aa563729a7 (4b89d215-5d16-418b-8772-c5aa563729a7): created successfully Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8bddbd-fc6f-4df0-b7c7-f6631f59c83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Flow 'volume_create_manager' (955aca77-e8d6-4ab2-a19a-8ffa2dcccf13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:14:53 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-868ac8ca-7258-4f58-8b9e-d4544ace4ec0 tempest-VolumeImageDependencyTests-1409162045 None] Created volume successfully. Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Acquiring lock "cinder-4b89d215-5d16-418b-8772-c5aa563729a7-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Lock "cinder-4b89d215-5d16-418b-8772-c5aa563729a7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Acquiring lock "cinder-quobyte-4b89d215-5d16-418b-8772-c5aa563729a7" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Lock "cinder-quobyte-4b89d215-5d16-418b-8772-c5aa563729a7" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4093b56c-de63-42d3-ba2a-82d1d6f5dc10]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:14:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:54 devstack sudo[112573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 Aug 26 19:14:54 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:54 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7" returned: 0 in 0.366s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:54 devstack sudo[112578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7 Aug 26 19:14:54 devstack sudo[112578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:54 devstack sudo[112580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:54 devstack sudo[112580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:54 devstack sudo[112578]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4b89d215-5d16-418b-8772-c5aa563729a7" returned: 0 in 0.253s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Lock "cinder-quobyte-4b89d215-5d16-418b-8772-c5aa563729a7" released by "delete_volume" :: held 0.661s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Created reservations ['3ff1fe42-d294-4229-bc51-61cb717ed5e3', 'bfa7ce94-8b2c-48cb-8ae7-e4f9e28e3269', '9123000e-c51a-41f3-932f-aacd6ca9bd99', 'ba41ad63-2d45-4bf3-88f1-f399230ae496'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:14:54 devstack sudo[112584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:14:54 devstack sudo[112584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:14:54 devstack sudo[112580]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.287s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:14:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:14:55 devstack sudo[112584]: pam_unix(sudo:session): session closed for user root Aug 26 19:14:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.296s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:14:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:14:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Deleted volume successfully. Aug 26 19:14:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e9a2d1b-f874-400c-878c-f9b56465bb7d tempest-VolumeImageDependencyTests-1409162045 None] Lock "cinder-4b89d215-5d16-418b-8772-c5aa563729a7-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:04 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=102,cinder:UPDATE=137,cinder:INSERT=39,cinder:DELETE=13 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:15:05 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=144,cinder:SELECT=95,cinder:INSERT=35,cinder:DELETE=12 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Flow 'volume_create_manager' (0f77f568-d538-4b49-b6a1-f60c070e5677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8418b09-e0ca-4bbd-a3ed-c9735fa31b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8418b09-e0ca-4bbd-a3ed-c9735fa31b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1504614057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09151343-91e7-4123-b3bd-e0c7259012f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afaac45e6f34d5b9226800e461ee8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:08Z,use_quota=True,user_id='a174be90068a4273a7618c6021b0077f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f752e3-2790-4ddb-a7bc-6a24f3453da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f752e3-2790-4ddb-a7bc-6a24f3453da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0658a6-154c-4c9a-9aad-b559f17f669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0658a6-154c-4c9a-9aad-b559f17f669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09151343-91e7-4123-b3bd-e0c7259012f8', 'volume_name': 'volume-09151343-91e7-4123-b3bd-e0c7259012f8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6033acc-8491-42cd-967f-b8d7673bc6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6033acc-8491-42cd-967f-b8d7673bc6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0833af4-ae66-49c1-a549-bbf92aa78346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:07 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Volume 09151343-91e7-4123-b3bd-e0c7259012f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09151343-91e7-4123-b3bd-e0c7259012f8', 'volume_size': 1} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1504614057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09151343-91e7-4123-b3bd-e0c7259012f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afaac45e6f34d5b9226800e461ee8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:08Z,use_quota=True,user_id='a174be90068a4273a7618c6021b0077f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Creating volume 09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:07 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:07 devstack sudo[112631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 1073741824 Aug 26 19:15:07 devstack sudo[112631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (9e4834b1-bb8e-4065-a6a8-685b350dfbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6010f838-3518-4d30-a59a-fe8e9276d14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6010f838-3518-4d30-a59a-fe8e9276d14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-653768112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ab7dad-8de8-41f0-b1c2-4abf00238117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:08Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cce945a-8ede-4e4a-912d-0611c67b4e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:07 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cce945a-8ede-4e4a-912d-0611c67b4e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d122f75-17fd-42d3-9c93-a98b0b30ba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d122f75-17fd-42d3-9c93-a98b0b30ba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ab7dad-8de8-41f0-b1c2-4abf00238117', 'volume_name': 'volume-72ab7dad-8de8-41f0-b1c2-4abf00238117', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395acc51-79b1-4053-9bf0-5e6fb57bf0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395acc51-79b1-4053-9bf0-5e6fb57bf0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4a4f8c-7f3a-4a8e-8342-a4db8b3bc7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Volume 72ab7dad-8de8-41f0-b1c2-4abf00238117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ab7dad-8de8-41f0-b1c2-4abf00238117', 'volume_size': 1} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (14ccda79-26e5-4a69-8859-26055aacfe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7405c6d-0f2f-4046-9b99-6fd37b3e2cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7405c6d-0f2f-4046-9b99-6fd37b3e2cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952616552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d1f485-b93a-47bf-9979-4576efa5832e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:08Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f23094f-4312-4096-8b0b-1fec0f6f06ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f23094f-4312-4096-8b0b-1fec0f6f06ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cb27fd-7f91-469f-91e4-3eccf1804ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cb27fd-7f91-469f-91e4-3eccf1804ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d1f485-b93a-47bf-9979-4576efa5832e', 'volume_name': 'volume-77d1f485-b93a-47bf-9979-4576efa5832e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088c0625-c5f9-4d7f-9431-0fe88cc13b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088c0625-c5f9-4d7f-9431-0fe88cc13b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60da82d8-37de-4fda-9558-66f7de4fdff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Volume 77d1f485-b93a-47bf-9979-4576efa5832e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d1f485-b93a-47bf-9979-4576efa5832e', 'volume_size': 1} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:08 devstack sudo[112631]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 1073741824" returned: 0 in 0.712s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:08 devstack sudo[112637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 Aug 26 19:15:08 devstack sudo[112637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (3df36c08-3675-4115-b572-f46623560b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3853ae5-f08d-4ae3-9432-6119b1902949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3853ae5-f08d-4ae3-9432-6119b1902949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-667780332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3510fa77-6ca1-45aa-a5b5-2a3f49b578f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:09Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091ee68d-16ef-4d1d-8947-2ecdf2108986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091ee68d-16ef-4d1d-8947-2ecdf2108986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b9c2be-aea6-4eb1-b775-4bfdf2df7329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b9c2be-aea6-4eb1-b775-4bfdf2df7329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3510fa77-6ca1-45aa-a5b5-2a3f49b578f5', 'volume_name': 'volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e444ca17-03ea-4b3a-9328-099ad9ca0839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e444ca17-03ea-4b3a-9328-099ad9ca0839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68568132-ec8f-452e-8785-36036bf3ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:08 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume 3510fa77-6ca1-45aa-a5b5-2a3f49b578f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5', 'volume_size': 1} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:08 devstack sudo[112637]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.937s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-653768112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ab7dad-8de8-41f0-b1c2-4abf00238117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:08Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Creating volume 72ab7dad-8de8-41f0-b1c2-4abf00238117 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:08 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0833af4-ae66-49c1-a549-bbf92aa78346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09151343-91e7-4123-b3bd-e0c7259012f8', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb9a342-c715-4319-9d2d-57ef51be9442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack sudo[112640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 1073741824 Aug 26 19:15:09 devstack sudo[112640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:09 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Volume volume-09151343-91e7-4123-b3bd-e0c7259012f8 (09151343-91e7-4123-b3bd-e0c7259012f8): created successfully Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb9a342-c715-4319-9d2d-57ef51be9442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Flow 'volume_create_manager' (0f77f568-d538-4b49-b6a1-f60c070e5677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:09 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-15f20393-9074-4234-baca-84c2b367eec9 tempest-VolumeDependencyTests-1016728560 None] Created volume successfully. Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (a340f46c-46a6-43a5-b7a3-320efe863206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ec0f8e-0961-4c98-bde3-f7e2a4751a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ec0f8e-0961-4c98-bde3-f7e2a4751a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-49237660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bf30e4-abef-486f-91f9-a23a55893188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:09Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d9bf3c-1cac-4a4a-99e4-0af5c7c82d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d9bf3c-1cac-4a4a-99e4-0af5c7c82d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ef2b3d-421f-409d-b34c-d149a92ad794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ef2b3d-421f-409d-b34c-d149a92ad794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74bf30e4-abef-486f-91f9-a23a55893188', 'volume_name': 'volume-74bf30e4-abef-486f-91f9-a23a55893188', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972d0d8b-730c-4c43-b490-2e2ca37d9290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972d0d8b-730c-4c43-b490-2e2ca37d9290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ffe0ac-8b02-46a6-8269-8911f218d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Volume 74bf30e4-abef-486f-91f9-a23a55893188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74bf30e4-abef-486f-91f9-a23a55893188', 'volume_size': 1} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (ee9aea0a-3c97-48b8-925e-ad45d9e18805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1758b7e8-c4c6-410b-8a06-16713ba56e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1758b7e8-c4c6-410b-8a06-16713ba56e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1296318118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979a8839-8082-49b1-8a92-c45bb723be4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:09Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack sudo[112640]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7237d097-e655-4bdc-9f22-f05fa5922d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7237d097-e655-4bdc-9f22-f05fa5922d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9be833-271b-4c4d-aafc-bd9a18becc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9be833-271b-4c4d-aafc-bd9a18becc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979a8839-8082-49b1-8a92-c45bb723be4f', 'volume_name': 'volume-979a8839-8082-49b1-8a92-c45bb723be4f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811afec0-2d80-4538-80ec-e1ab5f566c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811afec0-2d80-4538-80ec-e1ab5f566c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9291b2b7-13e3-4ba4-9805-1bcb9c8eac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:09 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Volume 979a8839-8082-49b1-8a92-c45bb723be4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979a8839-8082-49b1-8a92-c45bb723be4f', 'volume_size': 1} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 1073741824" returned: 0 in 0.695s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:09 devstack sudo[112646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 Aug 26 19:15:09 devstack sudo[112646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:10 devstack sudo[112646]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117" returned: 0 in 0.387s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952616552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d1f485-b93a-47bf-9979-4576efa5832e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:08Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Creating volume 77d1f485-b93a-47bf-9979-4576efa5832e {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:10 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:10 devstack sudo[112650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e 1073741824 Aug 26 19:15:10 devstack sudo[112650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4a4f8c-7f3a-4a8e-8342-a4db8b3bc7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ab7dad-8de8-41f0-b1c2-4abf00238117', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3397caab-771e-46e4-84b1-00193f4add92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (dcb03fe4-535d-4b31-9bd5-df19c5f18edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f159c73c-11ba-45e9-9cdd-e356b53219e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:10 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Volume volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 (72ab7dad-8de8-41f0-b1c2-4abf00238117): created successfully Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3397caab-771e-46e4-84b1-00193f4add92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (9e4834b1-bb8e-4065-a6a8-685b350dfbc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f159c73c-11ba-45e9-9cdd-e356b53219e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-786977706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264d77ba-3522-48c7-884e-30ba224054d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:10Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ff1069-d832-466f-bd81-1e7e13b37a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ff1069-d832-466f-bd81-1e7e13b37a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483bd001-5ade-4808-a468-3dc9d03b7cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483bd001-5ade-4808-a468-3dc9d03b7cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '264d77ba-3522-48c7-884e-30ba224054d7', 'volume_name': 'volume-264d77ba-3522-48c7-884e-30ba224054d7', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808af5ff-a2a5-4bc4-a364-346b48cc761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808af5ff-a2a5-4bc4-a364-346b48cc761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962111cf-8985-42ce-81dc-e318cf0f809b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:10 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Volume 264d77ba-3522-48c7-884e-30ba224054d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-264d77ba-3522-48c7-884e-30ba224054d7', 'volume_size': 1} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:10 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9405e560-e7e2-4bba-93b7-d75f65d94e3f tempest-CreateVolumesFromImageTest-1058897904 None] Created volume successfully. Aug 26 19:15:10 devstack sudo[112650]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e 1073741824" returned: 0 in 0.502s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:10 devstack sudo[112656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e Aug 26 19:15:10 devstack sudo[112656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:10 devstack sudo[112656]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e" returned: 0 in 0.264s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-667780332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3510fa77-6ca1-45aa-a5b5-2a3f49b578f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:09Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Creating volume 3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:10 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60da82d8-37de-4fda-9558-66f7de4fdff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d1f485-b93a-47bf-9979-4576efa5832e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaaddf2-9747-4c4d-ad53-afc87635932e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:11 devstack sudo[112659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 1073741824 Aug 26 19:15:11 devstack sudo[112659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:11 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Volume volume-77d1f485-b93a-47bf-9979-4576efa5832e (77d1f485-b93a-47bf-9979-4576efa5832e): created successfully Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaaddf2-9747-4c4d-ad53-afc87635932e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (14ccda79-26e5-4a69-8859-26055aacfe3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-dc18535f-a191-4de7-8581-ea128f8da5f1 tempest-CreateVolumesFromImageTest-1058897904 None] Created volume successfully. Aug 26 19:15:11 devstack sudo[112659]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 1073741824" returned: 0 in 0.500s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:11 devstack sudo[112665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 Aug 26 19:15:11 devstack sudo[112665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:11 devstack sudo[112665]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" returned: 0 in 0.252s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.522s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-49237660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bf30e4-abef-486f-91f9-a23a55893188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:09Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Creating volume 74bf30e4-abef-486f-91f9-a23a55893188 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:11 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:11 devstack sudo[112668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188 1073741824 Aug 26 19:15:11 devstack sudo[112668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68568132-ec8f-452e-8785-36036bf3ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e7c839-a021-4832-b988-620e3a9a477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:11 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 (3510fa77-6ca1-45aa-a5b5-2a3f49b578f5): created successfully Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e7c839-a021-4832-b988-620e3a9a477e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (3df36c08-3675-4115-b572-f46623560b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-bac0044e-e9e2-4a09-93b3-55175c12f36b tempest-CreateVolumesFromSnapshotTest-959410084 None] Created volume successfully. Aug 26 19:15:12 devstack sudo[112668]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188 1073741824" returned: 0 in 0.562s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Flow 'volume_create_manager' (2b47dfec-afe9-4635-840f-591ad576912f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c8f810-e506-4ecd-bd19-241d97c9cf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c8f810-e506-4ecd-bd19-241d97c9cf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ffeec6-a62c-49b8-a406-be2c8631b82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5462096a0545aa997895aecb0d6f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:12Z,use_quota=True,user_id='c826c260cbb643b485e08bb2a9d1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59ee8cae-de1f-43a1-bae5-6c17b0cfef0c),volume_type_id=59ee8cae-de1f-43a1-bae5-6c17b0cfef0c)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c59bd10-6fae-4c21-9793-537490908aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c59bd10-6fae-4c21-9793-537490908aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642c9f7b-7bf7-48ce-8e5e-086b719bcce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:12 devstack sudo[112673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188 Aug 26 19:15:12 devstack sudo[112673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642c9f7b-7bf7-48ce-8e5e-086b719bcce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35ffeec6-a62c-49b8-a406-be2c8631b82b', 'volume_name': 'volume-35ffeec6-a62c-49b8-a406-be2c8631b82b', 'volume_size': 1, 'image_id': '6ab674de-2870-4361-829c-fafb9fffd93d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ab674de-2870-4361-829c-fafb9fffd93d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04aa9fba1f7811202956a9c3f622897f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cf5462096a0545aa997895aecb0d6f79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd93a8715606e05ccf249a74d89bfeff53dfeac688a376aa9cea9a1c2780dbde7467dc8335af3b5102ddb8e444bf443a6cd7bfb9c9258a6679a0064c0dcc9c0e4', 'id': '6ab674de-2870-4361-829c-fafb9fffd93d', 'created_at': datetime.datetime(2026, 8, 26, 17, 15, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 15, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ab674de-2870-4361-829c-fafb9fffd93d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170346c0-6c8e-46d7-9cd9-7ddac0cce22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170346c0-6c8e-46d7-9cd9-7ddac0cce22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972f2cc5-f09f-4136-adcc-b6d7cee11507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:12 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Volume 35ffeec6-a62c-49b8-a406-be2c8631b82b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35ffeec6-a62c-49b8-a406-be2c8631b82b', 'volume_size': 1, 'image_id': '6ab674de-2870-4361-829c-fafb9fffd93d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ab674de-2870-4361-829c-fafb9fffd93d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04aa9fba1f7811202956a9c3f622897f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cf5462096a0545aa997895aecb0d6f79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd93a8715606e05ccf249a74d89bfeff53dfeac688a376aa9cea9a1c2780dbde7467dc8335af3b5102ddb8e444bf443a6cd7bfb9c9258a6679a0064c0dcc9c0e4', 'id': '6ab674de-2870-4361-829c-fafb9fffd93d', 'created_at': datetime.datetime(2026, 8, 26, 17, 15, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 15, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ab674de-2870-4361-829c-fafb9fffd93d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Trying to clone 35ffeec6-a62c-49b8-a406-be2c8631b82b from image 6ab674de-2870-4361-829c-fafb9fffd93d at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ab674de-2870-4361-829c-fafb9fffd93d', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 19:15:12 devstack sudo[112673]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188" returned: 0 in 0.261s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1296318118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979a8839-8082-49b1-8a92-c45bb723be4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:09Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Creating volume 979a8839-8082-49b1-8a92-c45bb723be4f {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:12 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ffe0ac-8b02-46a6-8269-8911f218d31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bf30e4-abef-486f-91f9-a23a55893188', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4169c137-6224-4f1d-865f-3fe00261e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:12 devstack sudo[112676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f 1073741824 Aug 26 19:15:12 devstack sudo[112676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 19:15:12 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Image download 0.00 MB at 0.00 MB/s Aug 26 19:15:12 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Volume volume-74bf30e4-abef-486f-91f9-a23a55893188 (74bf30e4-abef-486f-91f9-a23a55893188): created successfully Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4169c137-6224-4f1d-865f-3fe00261e342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (a340f46c-46a6-43a5-b7a3-320efe863206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:12 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-22fb0c95-8939-42be-938f-a12af6fad1d2 tempest-CreateVolumesFromImageTest-1058897904 None] Created volume successfully. Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[61828975-2e98-46f5-abbb-eb54a588c43a]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:12 devstack sudo[112678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD Aug 26 19:15:12 devstack sudo[112678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:13 devstack sudo[112678]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:13 devstack sudo[112676]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f 1073741824" returned: 0 in 0.517s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:13 devstack sudo[112688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f Aug 26 19:15:13 devstack sudo[112688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:13 devstack sudo[112687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD Aug 26 19:15:13 devstack sudo[112687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:13 devstack sudo[112687]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Temporary image 6ab674de-2870-4361-829c-fafb9fffd93d is fetched for user c826c260cbb643b485e08bb2a9d1a3f9. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 19:15:13 devstack sudo[112688]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f" returned: 0 in 0.262s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.331s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Creating offline snapshot dd7e7c38-7250-4b78-982a-c1773281a505 of volume 09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9291b2b7-13e3-4ba4-9805-1bcb9c8eac05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979a8839-8082-49b1-8a92-c45bb723be4f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e516aa1f-40df-46bc-9562-e48a797aa244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca5fa0-770e-44e4-b417-c570fd20ab2f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Volume volume-979a8839-8082-49b1-8a92-c45bb723be4f (979a8839-8082-49b1-8a92-c45bb723be4f): created successfully Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e516aa1f-40df-46bc-9562-e48a797aa244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (ee9aea0a-3c97-48b8-925e-ad45d9e18805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2659d0eb-a4ab-4ec5-a5cf-6c064a196b78]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-026692e3-fe44-41c4-bda2-3b87d011dc7a tempest-CreateVolumesFromImageTest-1058897904 None] Created volume successfully. Aug 26 19:15:13 devstack sudo[112695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 Aug 26 19:15:13 devstack sudo[112695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:13 devstack sudo[112696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD Aug 26 19:15:13 devstack sudo[112696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:13 devstack sudo[112695]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8" returned: 0 in 0.363s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:14 devstack sudo[112703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 1G Aug 26 19:15:14 devstack sudo[112703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:14 devstack sudo[112696]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:14 devstack sudo[112706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD Aug 26 19:15:14 devstack sudo[112706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:14 devstack sudo[112703]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 1G" returned: 0 in 0.426s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09151343-91e7-4123-b3bd-e0c7259012f8 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:14 devstack sudo[112715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09151343-91e7-4123-b3bd-e0c7259012f8 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 Aug 26 19:15:14 devstack sudo[112715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:14 devstack sudo[112706]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:14 devstack sudo[112715]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09151343-91e7-4123-b3bd-e0c7259012f8 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505" returned: 0 in 0.306s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:14 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 is being set with open permissions: ugo+rw Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:14 devstack sudo[112720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 Aug 26 19:15:14 devstack sudo[112720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:14 devstack sudo[112720]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505" returned: 0 in 0.265s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:15 devstack sudo[112723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.info Aug 26 19:15:15 devstack sudo[112723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:15 devstack sudo[112723]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.info" returned: 0 in 0.284s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:15 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.info is being set with open permissions: ugo+rw Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:15 devstack sudo[112726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.info Aug 26 19:15:15 devstack sudo[112726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:15 devstack sudo[112726]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.info" returned: 0 in 0.264s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.247s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-786977706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264d77ba-3522-48c7-884e-30ba224054d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b564b3cd084aba90571272f3967acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:10Z,use_quota=True,user_id='ccbe52da220342b2879570569f8f961f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Creating volume 264d77ba-3522-48c7-884e-30ba224054d7 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:15 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:15 devstack sudo[112729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7 1073741824 Aug 26 19:15:15 devstack sudo[112729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f753a54a-cc83-48e0-aabc-9e4b991c4fea tempest-VolumeDependencyTests-1016728560 None] Create snapshot completed successfully Aug 26 19:15:16 devstack sudo[112729]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7 1073741824" returned: 0 in 0.446s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:16 devstack sudo[112735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7 Aug 26 19:15:16 devstack sudo[112735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:16 devstack sudo[112735]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7" returned: 0 in 0.264s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.278s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962111cf-8985-42ce-81dc-e318cf0f809b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-264d77ba-3522-48c7-884e-30ba224054d7', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5884f396-d33f-48b4-bd4f-fbd9a072a24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Creating offline snapshot 301dc086-4ba2-4b7b-9254-77e044d8a964 of volume 3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:15:16 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Volume volume-264d77ba-3522-48c7-884e-30ba224054d7 (264d77ba-3522-48c7-884e-30ba224054d7): created successfully Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5884f396-d33f-48b4-bd4f-fbd9a072a24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Flow 'volume_create_manager' (dcb03fe4-535d-4b31-9bd5-df19c5f18edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[207508ed-464e-4fe7-8c6a-bd3848b5ad29]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:16 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-671496ca-6797-44ae-87ae-e334f77c2edf tempest-CreateVolumesFromImageTest-1058897904 None] Created volume successfully. Aug 26 19:15:16 devstack sudo[112738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 Aug 26 19:15:16 devstack sudo[112738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-264d77ba-3522-48c7-884e-30ba224054d7-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-264d77ba-3522-48c7-884e-30ba224054d7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-quobyte-264d77ba-3522-48c7-884e-30ba224054d7" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-264d77ba-3522-48c7-884e-30ba224054d7" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd74fb07-6ada-4ab5-87d7-ece8691ec901]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:16 devstack sudo[112738]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" returned: 0 in 0.433s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:16 devstack sudo[112744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 1G Aug 26 19:15:16 devstack sudo[112744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:16 devstack sudo[112743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7 Aug 26 19:15:16 devstack sudo[112743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:16 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Flow 'volume_create_manager' (6145c27f-4b59-41fc-887c-bcadfac826d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b04fdb2-3fe7-4362-8a60-c4e2f2683e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b04fdb2-3fe7-4362-8a60-c4e2f2683e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-980733309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77e31bc-682d-4da6-8d7a-af84ca843eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2afaac45e6f34d5b9226800e461ee8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd7e7c38-7250-4b78-982a-c1773281a505,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:17Z,use_quota=True,user_id='a174be90068a4273a7618c6021b0077f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e568d5-96a6-457e-8809-2b60a8ba8924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e568d5-96a6-457e-8809-2b60a8ba8924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244ca3a3-91b4-48e3-96fa-8c2211da748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244ca3a3-91b4-48e3-96fa-8c2211da748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f77e31bc-682d-4da6-8d7a-af84ca843eec', 'volume_name': 'volume-f77e31bc-682d-4da6-8d7a-af84ca843eec', 'volume_size': 1, 'snapshot_id': 'dd7e7c38-7250-4b78-982a-c1773281a505'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b73b9da-3e82-4494-9e90-bd09d2b986ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b73b9da-3e82-4494-9e90-bd09d2b986ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dccb84b-c17a-4519-820b-ac69a0730134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:17 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Volume f77e31bc-682d-4da6-8d7a-af84ca843eec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f77e31bc-682d-4da6-8d7a-af84ca843eec', 'volume_size': 1, 'snapshot_id': 'dd7e7c38-7250-4b78-982a-c1773281a505'} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:17 devstack sudo[112743]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7" returned: 0 in 0.408s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:17 devstack sudo[112753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7 Aug 26 19:15:17 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:17 devstack sudo[112744]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 1G" returned: 0 in 0.505s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:17 devstack sudo[112756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 Aug 26 19:15:17 devstack sudo[112756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:17 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-264d77ba-3522-48c7-884e-30ba224054d7" returned: 0 in 0.246s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-264d77ba-3522-48c7-884e-30ba224054d7" released by "delete_volume" :: held 0.713s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Created reservations ['76f68321-4b55-4e4f-bef5-2e50de2f8f99', 'ba02535b-7db9-4eae-bbdf-1e40098a58cb', '4a102121-320d-4038-95b6-640296511b4c', 'a6db276c-fd82-4bf8-bdeb-84df440e81ac'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:17 devstack sudo[112762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:17 devstack sudo[112762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:17 devstack sudo[112756]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964" returned: 0 in 0.335s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:17 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 is being set with open permissions: ugo+rw Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:17 devstack sudo[112765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 Aug 26 19:15:17 devstack sudo[112765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:17 devstack sudo[112762]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-979a8839-8082-49b1-8a92-c45bb723be4f-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.272s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Deleted volume successfully. Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-979a8839-8082-49b1-8a92-c45bb723be4f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a60c9355-746b-4ef4-be04-9893834c7955 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-264d77ba-3522-48c7-884e-30ba224054d7-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-quobyte-979a8839-8082-49b1-8a92-c45bb723be4f" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:17 devstack sudo[112765]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964" returned: 0 in 0.287s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-979a8839-8082-49b1-8a92-c45bb723be4f" acquired by "delete_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a5bad2-3ebd-49ad-b6c3-383825dede80]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:18 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.info Aug 26 19:15:18 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:18 devstack sudo[112770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f Aug 26 19:15:18 devstack sudo[112770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:18 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.info" returned: 0 in 0.258s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:18 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.info is being set with open permissions: ugo+rw Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:18 devstack sudo[112774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.info Aug 26 19:15:18 devstack sudo[112774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:18 devstack sudo[112770]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f" returned: 0 in 0.420s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:18 devstack sudo[112779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f Aug 26 19:15:18 devstack sudo[112779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:18 devstack sudo[112774]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.info" returned: 0 in 0.258s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ffeec6-a62c-49b8-a406-be2c8631b82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5462096a0545aa997895aecb0d6f79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:12Z,use_quota=True,user_id='c826c260cbb643b485e08bb2a9d1a3f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59ee8cae-de1f-43a1-bae5-6c17b0cfef0c),volume_type_id=59ee8cae-de1f-43a1-bae5-6c17b0cfef0c)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Creating volume 35ffeec6-a62c-49b8-a406-be2c8631b82b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:18 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:18 devstack sudo[112782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b 1073741824 Aug 26 19:15:18 devstack sudo[112782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:18 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-5f9b4cd6-4753-4572-9b26-dc836f975d59 tempest-CreateVolumesFromSnapshotTest-959410084 None] Create snapshot completed successfully Aug 26 19:15:18 devstack sudo[112779]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-979a8839-8082-49b1-8a92-c45bb723be4f" returned: 0 in 0.266s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-979a8839-8082-49b1-8a92-c45bb723be4f" released by "delete_volume" :: held 0.747s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Created reservations ['ef8757d5-6a84-48a5-bc38-f0716afe6ab7', '70e2c565-1b23-4725-96ed-1b1fc3d167ff', 'b542a030-fbb6-4938-bf66-932854619178', '44b59bd7-c4a8-4b64-9de0-51d4de843fde'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:18 devstack sudo[112788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:18 devstack sudo[112788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:19 devstack sudo[112782]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-74bf30e4-abef-486f-91f9-a23a55893188-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b 1073741824" returned: 0 in 0.539s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-74bf30e4-abef-486f-91f9-a23a55893188-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:19 devstack sudo[112791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-quobyte-74bf30e4-abef-486f-91f9-a23a55893188" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:19 devstack sudo[112791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-74bf30e4-abef-486f-91f9-a23a55893188" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:19 devstack sudo[112788]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.368s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Deleted volume successfully. Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a081db1d-95a4-4092-abde-e567d2139fe9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-906ccf77-53f6-4ffc-8944-2e84d7966365 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-979a8839-8082-49b1-8a92-c45bb723be4f-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:19 devstack sudo[112794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188 Aug 26 19:15:19 devstack sudo[112794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:19 devstack sudo[112791]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.369s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "cinder-quobyte-dd7e7c38-7250-4b78-982a-c1773281a505-f77e31bc-682d-4da6-8d7a-af84ca843eec" by "_create_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-dd7e7c38-7250-4b78-982a-c1773281a505-f77e31bc-682d-4da6-8d7a-af84ca843eec" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Creating volume f77e31bc-682d-4da6-8d7a-af84ca843eec from snapshot dd7e7c38-7250-4b78-982a-c1773281a505 {{(pid=93671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "cinder-quobyte-f77e31bc-682d-4da6-8d7a-af84ca843eec" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Attempting download of 6ab674de-2870-4361-829c-fafb9fffd93d ((None, [{'url': 'file:///opt/stack/data/glance/images/6ab674de-2870-4361-829c-fafb9fffd93d', 'metadata': {}}])) to volume 35ffeec6-a62c-49b8-a406-be2c8631b82b. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-f77e31bc-682d-4da6-8d7a-af84ca843eec" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] snapshot: dd7e7c38-7250-4b78-982a-c1773281a505, volume: f77e31bc-682d-4da6-8d7a-af84ca843eec, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68c7e27-f067-470f-a4eb-555f5088849d]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5a1600-a232-431f-aa52-da939a6fced9]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ab674de-2870-4361-829c-fafb9fffd93d__zjh75ws {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:19 devstack sudo[112798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 Aug 26 19:15:19 devstack sudo[112798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:19 devstack sudo[112794]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188" returned: 0 in 0.518s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:19 devstack sudo[112800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ab674de-2870-4361-829c-fafb9fffd93d__zjh75ws Aug 26 19:15:19 devstack sudo[112800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:19 devstack sudo[112803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188 Aug 26 19:15:19 devstack sudo[112803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:20 devstack sudo[112800]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (29b63c24-dc61-4d4b-8fb9-387dae39fa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0acb24-715f-4715-8b76-096d2d88fe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ab674de-2870-4361-829c-fafb9fffd93d__zjh75ws" returned: 0 in 0.547s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ab674de-2870-4361-829c-fafb9fffd93d__zjh75ws {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:20 devstack sudo[112803]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0acb24-715f-4715-8b76-096d2d88fe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1386097863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a385298a-8bd3-4d99-b64a-f314bfac61a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:20Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:20 devstack sudo[112798]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711a1af3-b29a-41b8-a084-0a9199469079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711a1af3-b29a-41b8-a084-0a9199469079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6b9c0d-c15e-4322-af64-e71ef777eaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6b9c0d-c15e-4322-af64-e71ef777eaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a385298a-8bd3-4d99-b64a-f314bfac61a9', 'volume_name': 'volume-a385298a-8bd3-4d99-b64a-f314bfac61a9', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee1b65-3561-4917-bf10-9c16c3893fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee1b65-3561-4917-bf10-9c16c3893fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03515572-36bc-4d65-9df4-4fee1e664ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume a385298a-8bd3-4d99-b64a-f314bfac61a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a385298a-8bd3-4d99-b64a-f314bfac61a9', 'volume_size': 1} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505" returned: 0 in 0.722s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-74bf30e4-abef-486f-91f9-a23a55893188" returned: 0 in 0.553s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09151343-91e7-4123-b3bd-e0c7259012f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8edf17-a728-4bc8-bc77-f08894fc2ea8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-74bf30e4-abef-486f-91f9-a23a55893188" released by "delete_volume" :: held 1.165s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:20 devstack sudo[112812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ab674de-2870-4361-829c-fafb9fffd93d__zjh75ws Aug 26 19:15:20 devstack sudo[112812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Created reservations ['a9ac9798-7389-404b-9646-f753aefbe5fa', '706142ef-4bce-4daa-b096-31a488b06fee', '60a71a05-0199-4748-a987-64d03ce2a21c', 'd7614832-873b-4176-9fab-656c987b3ae4'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:20 devstack sudo[112813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 Aug 26 19:15:20 devstack sudo[112813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (ca9685ee-3c7f-4337-9eda-08735b3caf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bee87b5-2e92-4010-b6b3-b43feae80719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bee87b5-2e92-4010-b6b3-b43feae80719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-501858720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a55a782-9f37-4bdf-a902-651053878cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:20Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7eba7a9-9f6d-4927-8a8b-acfe82728db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7eba7a9-9f6d-4927-8a8b-acfe82728db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2663a1-9227-48c5-87ca-60012486e020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2663a1-9227-48c5-87ca-60012486e020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a55a782-9f37-4bdf-a902-651053878cb6', 'volume_name': 'volume-9a55a782-9f37-4bdf-a902-651053878cb6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e29f5f-c41e-474b-9f0c-488d1742155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e29f5f-c41e-474b-9f0c-488d1742155b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1919aa29-8889-4938-9f02-d07cf465b796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:20 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume 9a55a782-9f37-4bdf-a902-651053878cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a55a782-9f37-4bdf-a902-651053878cb6', 'volume_size': 1} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:20 devstack sudo[112818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:20 devstack sudo[112818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:20 devstack sudo[112812]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ab674de-2870-4361-829c-fafb9fffd93d__zjh75ws" returned: 1 in 0.576s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ab674de-2870-4361-829c-fafb9fffd93d__zjh75ws' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5a12bf-8b93-4ad2-8585-a4956193886f]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:20 devstack sudo[112820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD Aug 26 19:15:20 devstack sudo[112820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:21 devstack sudo[112813]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8" returned: 0 in 0.654s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:21 devstack sudo[112825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec Aug 26 19:15:21 devstack sudo[112825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (e7ad043b-9493-4b17-80fa-e4be2a0d969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca10b071-75f3-4ce9-9202-6bed972ca571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca10b071-75f3-4ce9-9202-6bed972ca571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048215306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8f454b-4f43-4cac-b903-289f50116585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:21Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde7cb6d-e756-4599-9055-bc7bc2725482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde7cb6d-e756-4599-9055-bc7bc2725482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad465a4c-4f06-442a-a427-609af742bd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad465a4c-4f06-442a-a427-609af742bd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8f454b-4f43-4cac-b903-289f50116585', 'volume_name': 'volume-4d8f454b-4f43-4cac-b903-289f50116585', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be191ef-562c-4595-9080-27bf8eb364be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack sudo[112820]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be191ef-562c-4595-9080-27bf8eb364be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f2f652-c30d-4cec-b712-f033e4bb8f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume 4d8f454b-4f43-4cac-b903-289f50116585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8f454b-4f43-4cac-b903-289f50116585', 'volume_size': 1} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:21 devstack sudo[112818]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.567s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Deleted volume successfully. Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (4f1c3ebd-0654-4a89-a797-47902d769487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b6bfd7-4996-4bfb-8864-dc44aa6337d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5448cb5-ad0b-4ffd-8638-39e65033d48e tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-74bf30e4-abef-486f-91f9-a23a55893188-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b6bfd7-4996-4bfb-8864-dc44aa6337d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047490026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67996cc6-493b-4567-bd29-966395c3659b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:21Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ad6dff-965e-42a9-bdb7-86b32b3def18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ad6dff-965e-42a9-bdb7-86b32b3def18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ec3eb9-b2ad-4dbb-9683-c84fe63d188a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ec3eb9-b2ad-4dbb-9683-c84fe63d188a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67996cc6-493b-4567-bd29-966395c3659b', 'volume_name': 'volume-67996cc6-493b-4567-bd29-966395c3659b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b48b318-37b0-4bb0-a13a-c159011d68c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b48b318-37b0-4bb0-a13a-c159011d68c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:21 devstack sudo[112830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD Aug 26 19:15:21 devstack sudo[112830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020317c4-a304-46b2-80e4-4c3e03e482b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume 67996cc6-493b-4567-bd29-966395c3659b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67996cc6-493b-4567-bd29-966395c3659b', 'volume_size': 1} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-77d1f485-b93a-47bf-9979-4576efa5832e-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-77d1f485-b93a-47bf-9979-4576efa5832e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-quobyte-77d1f485-b93a-47bf-9979-4576efa5832e" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-77d1f485-b93a-47bf-9979-4576efa5832e" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2363a89-bfe1-459f-b58f-ce15d9dc92b4]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:21 devstack sudo[112836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e Aug 26 19:15:21 devstack sudo[112836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:21 devstack sudo[112830]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (4bf1bd5b-571e-495a-8221-4eb163fd1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f3f16b-3432-48ee-9f9c-4776fc4c4303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD" returned: 1 in 0.577s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] 6ab674de-2870-4361-829c-fafb9fffd93d was raw, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f3f16b-3432-48ee-9f9c-4776fc4c4303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1979307469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5772ab-abca-4415-8ad7-5a2872a0e133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:22Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:21 devstack sudo[112847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b Aug 26 19:15:21 devstack sudo[112847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec453a0e-9fbf-4f37-805b-9072f51cb001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec453a0e-9fbf-4f37-805b-9072f51cb001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4bdd28-67c2-4341-a2bf-ba7b9a8ce898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4bdd28-67c2-4341-a2bf-ba7b9a8ce898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5772ab-abca-4415-8ad7-5a2872a0e133', 'volume_name': 'volume-4e5772ab-abca-4415-8ad7-5a2872a0e133', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec91e7b1-17b6-4cf9-9199-82e9980d6d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec91e7b1-17b6-4cf9-9199-82e9980d6d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4139c9c3-b07e-4dd7-a161-230a8045fea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:22 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume 4e5772ab-abca-4415-8ad7-5a2872a0e133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5772ab-abca-4415-8ad7-5a2872a0e133', 'volume_size': 1} Aug 26 19:15:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:22 devstack sudo[112836]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e" returned: 0 in 0.895s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:22 devstack sudo[112855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e Aug 26 19:15:22 devstack sudo[112855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:23 devstack sudo[112847]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b" returned: 0 in 1.185s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ab674de-2870-4361-829c-fafb9fffd93d_68ogoadsdevstack@QuobyteHD, size 0.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:15:23 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:23 devstack sudo[112859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b 1G Aug 26 19:15:23 devstack sudo[112859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:23 devstack sudo[112855]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-77d1f485-b93a-47bf-9979-4576efa5832e" returned: 0 in 0.645s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-77d1f485-b93a-47bf-9979-4576efa5832e" released by "delete_volume" :: held 1.635s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Created reservations ['3278a211-2c97-4be3-9f09-3a0948fc9396', 'fc22b8e3-4ba6-4746-8c6e-abc106877ff4', 'dea2b80c-3e61-42db-91a9-cc25d74bedb9', '595ba169-fd68-40f7-85fe-1082675482f2'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:23 devstack sudo[112861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:23 devstack sudo[112861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:24 devstack sudo[112859]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b 1G" returned: 0 in 0.967s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Downloaded image 6ab674de-2870-4361-829c-fafb9fffd93d ((None, [{'url': 'file:///opt/stack/data/glance/images/6ab674de-2870-4361-829c-fafb9fffd93d', 'metadata': {}}])) to volume 35ffeec6-a62c-49b8-a406-be2c8631b82b successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Temporary image 6ab674de-2870-4361-829c-fafb9fffd93d for user c826c260cbb643b485e08bb2a9d1a3f9 is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Marking volume 35ffeec6-a62c-49b8-a406-be2c8631b82b as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Copying metadata from image 6ab674de-2870-4361-829c-fafb9fffd93d to 35ffeec6-a62c-49b8-a406-be2c8631b82b. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Creating volume glance metadata for volume 35ffeec6-a62c-49b8-a406-be2c8631b82b backed by image 6ab674de-2870-4361-829c-fafb9fffd93d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6ab674de-2870-4361-829c-fafb9fffd93d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '04aa9fba1f7811202956a9c3f622897f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-72ab7dad-8de8-41f0-b1c2-4abf00238117-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-72ab7dad-8de8-41f0-b1c2-4abf00238117-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:24 devstack sudo[112861]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.747s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:24 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Deleted volume successfully. Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972f2cc5-f09f-4136-adcc-b6d7cee11507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ffeec6-a62c-49b8-a406-be2c8631b82b', 'volume_size': 1, 'image_id': '6ab674de-2870-4361-829c-fafb9fffd93d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ab674de-2870-4361-829c-fafb9fffd93d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04aa9fba1f7811202956a9c3f622897f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cf5462096a0545aa997895aecb0d6f79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd93a8715606e05ccf249a74d89bfeff53dfeac688a376aa9cea9a1c2780dbde7467dc8335af3b5102ddb8e444bf443a6cd7bfb9c9258a6679a0064c0dcc9c0e4', 'id': '6ab674de-2870-4361-829c-fafb9fffd93d', 'created_at': datetime.datetime(2026, 8, 26, 17, 15, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 15, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ab674de-2870-4361-829c-fafb9fffd93d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306cc9a1-a94e-40a1-8b85-80a37321cb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "cinder-quobyte-72ab7dad-8de8-41f0-b1c2-4abf00238117" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9eac105-9049-48b0-8ec3-d04e25de7ffe tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-77d1f485-b93a-47bf-9979-4576efa5832e-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:24 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Volume volume-35ffeec6-a62c-49b8-a406-be2c8631b82b (35ffeec6-a62c-49b8-a406-be2c8631b82b): created successfully Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306cc9a1-a94e-40a1-8b85-80a37321cb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Flow 'volume_create_manager' (2b47dfec-afe9-4635-840f-591ad576912f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-72ab7dad-8de8-41f0-b1c2-4abf00238117" acquired by "delete_volume" :: waited 0.068s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:24 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9dc69aa3-fa63-4909-9503-c10a9f7ef391 tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Created volume successfully. Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a3934-0ab9-4c75-8f6d-7dc82e251c93]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:24 devstack sudo[112867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 Aug 26 19:15:24 devstack sudo[112867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:25 devstack sudo[112867]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117" returned: 0 in 0.831s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:25 devstack sudo[112872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117 Aug 26 19:15:25 devstack sudo[112872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Acquiring lock "cinder-35ffeec6-a62c-49b8-a406-be2c8631b82b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "cinder-35ffeec6-a62c-49b8-a406-be2c8631b82b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Acquiring lock "cinder-quobyte-35ffeec6-a62c-49b8-a406-be2c8631b82b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:26 devstack sudo[112872]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "cinder-quobyte-35ffeec6-a62c-49b8-a406-be2c8631b82b" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-72ab7dad-8de8-41f0-b1c2-4abf00238117" returned: 0 in 0.654s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-quobyte-72ab7dad-8de8-41f0-b1c2-4abf00238117" released by "delete_volume" :: held 1.596s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65fd191-387e-4018-8d3c-00c94afb9224]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Created reservations ['b9163d8f-efe6-4a43-8034-cb016ad479ff', 'def30c53-d71d-4edf-8b5b-cc10e344b70d', '7555f681-3df9-4c17-98af-e6161eeb311a', '3cc2b7c8-4d00-4058-a087-1bfa74143d03'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:26 devstack sudo[112875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b Aug 26 19:15:26 devstack sudo[112875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:26 devstack sudo[112877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:26 devstack sudo[112877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:26 devstack sudo[112825]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec" returned: 0 in 5.888s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:15:26 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Converted 1024.00 MB image at 173.79 MB/s Aug 26 19:15:26 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec is being set with open permissions: ugo+rw Aug 26 19:15:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:26 devstack sudo[112881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec Aug 26 19:15:26 devstack sudo[112881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:27 devstack sudo[112875]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b" returned: 0 in 0.813s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:27 devstack sudo[112884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b Aug 26 19:15:27 devstack sudo[112884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:27 devstack sudo[112877]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:27 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Deleted volume successfully. Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-48cbab3b-c8fb-4dc2-93da-13b8fcc33884 tempest-CreateVolumesFromImageTest-1058897904 None] Lock "cinder-72ab7dad-8de8-41f0-b1c2-4abf00238117-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:27 devstack sudo[112881]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec" returned: 0 in 0.336s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-f77e31bc-682d-4da6-8d7a-af84ca843eec" released by "_copy_volume_from_snapshot" :: held 7.740s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-dd7e7c38-7250-4b78-982a-c1773281a505-f77e31bc-682d-4da6-8d7a-af84ca843eec" released by "_create_volume_from_snapshot" :: held 7.821s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.853s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.975s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1386097863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a385298a-8bd3-4d99-b64a-f314bfac61a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:20Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Creating volume a385298a-8bd3-4d99-b64a-f314bfac61a9 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:27 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:27 devstack sudo[112884]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:27 devstack sudo[112889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 1073741824 Aug 26 19:15:27 devstack sudo[112889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-35ffeec6-a62c-49b8-a406-be2c8631b82b" returned: 0 in 0.347s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dccb84b-c17a-4519-820b-ac69a0730134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f77e31bc-682d-4da6-8d7a-af84ca843eec', 'volume_size': 1, 'snapshot_id': 'dd7e7c38-7250-4b78-982a-c1773281a505'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e057716-d54d-4d9c-a0a5-c0295585abaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "cinder-quobyte-35ffeec6-a62c-49b8-a406-be2c8631b82b" released by "delete_volume" :: held 1.259s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:27 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Volume volume-f77e31bc-682d-4da6-8d7a-af84ca843eec (f77e31bc-682d-4da6-8d7a-af84ca843eec): created successfully Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e057716-d54d-4d9c-a0a5-c0295585abaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Flow 'volume_create_manager' (6145c27f-4b59-41fc-887c-bcadfac826d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:27 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d6e62ae0-12bc-4fe0-8587-52ab3a32cf3d tempest-VolumeDependencyTests-1016728560 None] Created volume successfully. Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Created reservations ['eb95e1a3-752a-4e66-a65a-46a7a7ebd0d2', '48169544-c1a0-48b8-b252-c99e4d9659f9', '0aa26bed-e408-4627-a502-cb28bc60069d', '1ca4e16c-5633-49f9-9173-31ab5067f3ff'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:27 devstack sudo[112892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:27 devstack sudo[112892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:27 devstack sudo[112889]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 1073741824" returned: 0 in 0.508s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:27 devstack sudo[112892]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:27 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Deleted volume successfully. Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:27 devstack sudo[112900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 Aug 26 19:15:27 devstack sudo[112900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:27 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c6eea192-b836-442e-9b01-30c2ae2bdaad tempest-VolumeAndVolumeTypeFromImageTest-509754722 None] Lock "cinder-35ffeec6-a62c-49b8-a406-be2c8631b82b-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:28 devstack sudo[112900]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9" returned: 0 in 0.273s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.494s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-501858720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a55a782-9f37-4bdf-a902-651053878cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:20Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Creating volume 9a55a782-9f37-4bdf-a902-651053878cb6 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:28 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03515572-36bc-4d65-9df4-4fee1e664ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a385298a-8bd3-4d99-b64a-f314bfac61a9', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:28 devstack sudo[112904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6 1073741824 Aug 26 19:15:28 devstack sudo[112904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276b6b51-4bb2-49bd-8663-04e836f0deab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:28 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 (a385298a-8bd3-4d99-b64a-f314bfac61a9): created successfully Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276b6b51-4bb2-49bd-8663-04e836f0deab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (29b63c24-dc61-4d4b-8fb9-387dae39fa2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-17af2132-983c-48d1-97d0-e43f2b64ad03 tempest-CreateVolumesFromSnapshotTest-959410084 None] Created volume successfully. Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "cinder-dd7e7c38-7250-4b78-982a-c1773281a505-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-dd7e7c38-7250-4b78-982a-c1773281a505-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "cinder-quobyte-09151343-91e7-4123-b3bd-e0c7259012f8" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-09151343-91e7-4123-b3bd-e0c7259012f8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "cinder-quobyte-dd7e7c38-7250-4b78-982a-c1773281a505" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-dd7e7c38-7250-4b78-982a-c1773281a505" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Deleting offline snapshot dd7e7c38-7250-4b78-982a-c1773281a505 of volume 09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] snapshot_file for this snap is: volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[545b9b5b-b986-4ee6-bff9-cfe124005c65]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:28 devstack sudo[112909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 Aug 26 19:15:28 devstack sudo[112909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:28 devstack sudo[112904]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6 1073741824" returned: 0 in 0.646s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:28 devstack sudo[112911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6 Aug 26 19:15:28 devstack sudo[112911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:29 devstack sudo[112909]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505" returned: 0 in 0.521s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09151343-91e7-4123-b3bd-e0c7259012f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[14868a45-7a55-41d1-9841-dc5ee3478bd1]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:29 devstack sudo[112911]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6" returned: 0 in 0.354s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.965s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048215306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8f454b-4f43-4cac-b903-289f50116585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:21Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Creating volume 4d8f454b-4f43-4cac-b903-289f50116585 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:29 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1919aa29-8889-4938-9f02-d07cf465b796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a55a782-9f37-4bdf-a902-651053878cb6', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:29 devstack sudo[112918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585 1073741824 Aug 26 19:15:29 devstack sudo[112918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10094ff-6f2e-4607-87f5-52c677fb1b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:29 devstack sudo[112916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 Aug 26 19:15:29 devstack sudo[112916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:29 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume volume-9a55a782-9f37-4bdf-a902-651053878cb6 (9a55a782-9f37-4bdf-a902-651053878cb6): created successfully Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10094ff-6f2e-4607-87f5-52c677fb1b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (ca9685ee-3c7f-4337-9eda-08735b3caf5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:29 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-739c8286-aa23-47ad-9e3a-3b43b3b07c9c tempest-CreateVolumesFromSnapshotTest-959410084 None] Created volume successfully. Aug 26 19:15:29 devstack sudo[112918]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:29 devstack sudo[112916]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585 1073741824" returned: 0 in 0.673s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8" returned: 0 in 0.791s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:29 devstack sudo[112928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 Aug 26 19:15:29 devstack sudo[112928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:30 devstack sudo[112930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585 Aug 26 19:15:30 devstack sudo[112930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:30 devstack sudo[112930]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.852s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047490026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67996cc6-493b-4567-bd29-966395c3659b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:21Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Creating volume 67996cc6-493b-4567-bd29-966395c3659b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:30 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f2f652-c30d-4cec-b712-f033e4bb8f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8f454b-4f43-4cac-b903-289f50116585', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa719bf-338c-43d8-9562-2c5e7d21712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:30 devstack sudo[112937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b 1073741824 Aug 26 19:15:30 devstack sudo[112937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:30 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume volume-4d8f454b-4f43-4cac-b903-289f50116585 (4d8f454b-4f43-4cac-b903-289f50116585): created successfully Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa719bf-338c-43d8-9562-2c5e7d21712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (e7ad043b-9493-4b17-80fa-e4be2a0d969d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:30 devstack sudo[112928]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505" returned: 0 in 0.514s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-cf51b9ca-c326-42f4-b5ec-fdd97a851160 tempest-CreateVolumesFromSnapshotTest-959410084 None] Created volume successfully. Aug 26 19:15:30 devstack sudo[112939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505 Aug 26 19:15:30 devstack sudo[112939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:30 devstack sudo[112939]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8.dd7e7c38-7250-4b78-982a-c1773281a505" returned: 0 in 0.304s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-dd7e7c38-7250-4b78-982a-c1773281a505" released by "_delete_snapshot" :: held 2.274s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-09151343-91e7-4123-b3bd-e0c7259012f8" released by "delete_snapshot" :: held 2.302s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:30 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Created reservations ['b9daeca3-5e95-4bee-823c-274b99a73ba0', '225218cf-994a-4869-97c2-0b7ef09e3d6f', 'e46c4eaa-ad79-47a0-9641-1cd5099cfd8f', '71a65ade-b598-4f5c-90f6-553d9d8ebf24'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Delete snapshot completed successfully. Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-125a0930-7e67-4571-9b5e-73c2285cb1a1 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-dd7e7c38-7250-4b78-982a-c1773281a505-delete_snapshot" released by "delete_snapshot" :: held 2.619s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:31 devstack sudo[112937]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b 1073741824" returned: 0 in 0.746s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:31 devstack sudo[112946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b Aug 26 19:15:31 devstack sudo[112946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (98e6f3da-607b-4a33-ba1a-81f4edab17d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2655d2b1-c17d-4ae3-90ff-dd8a126e6309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2655d2b1-c17d-4ae3-90ff-dd8a126e6309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1080209268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6cd016-5624-4d6d-9c87-1251ab775a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:31Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b5f3f1-fa0d-4418-9344-9caccb1836c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b5f3f1-fa0d-4418-9344-9caccb1836c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ab0234-23b6-446d-928d-822d8a903b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ab0234-23b6-446d-928d-822d8a903b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6cd016-5624-4d6d-9c87-1251ab775a73', 'volume_name': 'volume-9d6cd016-5624-4d6d-9c87-1251ab775a73', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b312484-1b3e-4089-81c4-8fa8ec37cc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b312484-1b3e-4089-81c4-8fa8ec37cc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bff8200-5265-4aaf-a823-79f19ed58650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume 9d6cd016-5624-4d6d-9c87-1251ab775a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6cd016-5624-4d6d-9c87-1251ab775a73', 'volume_size': 1} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:31 devstack sudo[112946]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b" returned: 0 in 0.274s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.394s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1979307469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5772ab-abca-4415-8ad7-5a2872a0e133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13898add5e4c5eae9df047c24174fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:22Z,use_quota=True,user_id='f7887d12accc4102920a097ff3be3309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Creating volume 4e5772ab-abca-4415-8ad7-5a2872a0e133 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:31 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020317c4-a304-46b2-80e4-4c3e03e482b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67996cc6-493b-4567-bd29-966395c3659b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:31 devstack sudo[112949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 1073741824 Aug 26 19:15:31 devstack sudo[112949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f65383d-4eab-4bb1-9901-55de6f0906d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume volume-67996cc6-493b-4567-bd29-966395c3659b (67996cc6-493b-4567-bd29-966395c3659b): created successfully Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f65383d-4eab-4bb1-9901-55de6f0906d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (4f1c3ebd-0654-4a89-a797-47902d769487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-94a82cea-87b8-461c-855a-cffb786901c1 tempest-CreateVolumesFromSnapshotTest-959410084 None] Created volume successfully. Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "cinder-09151343-91e7-4123-b3bd-e0c7259012f8-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-09151343-91e7-4123-b3bd-e0c7259012f8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "cinder-quobyte-09151343-91e7-4123-b3bd-e0c7259012f8" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-09151343-91e7-4123-b3bd-e0c7259012f8" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e63dad1-f8b6-4f32-b514-3a243ac41f4a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:31 devstack sudo[112955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 Aug 26 19:15:31 devstack sudo[112955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:31 devstack sudo[112949]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 1073741824" returned: 0 in 0.534s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:32 devstack sudo[112957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 Aug 26 19:15:32 devstack sudo[112957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:32 devstack sudo[112955]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8" returned: 0 in 0.485s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:32 devstack sudo[112957]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133" returned: 0 in 0.335s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:32 devstack sudo[112963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8 Aug 26 19:15:32 devstack sudo[112963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1080209268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6cd016-5624-4d6d-9c87-1251ab775a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:31Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Creating volume 9d6cd016-5624-4d6d-9c87-1251ab775a73 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:32 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4139c9c3-b07e-4dd7-a161-230a8045fea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5772ab-abca-4415-8ad7-5a2872a0e133', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:32 devstack sudo[112965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 1073741824 Aug 26 19:15:32 devstack sudo[112965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849650d7-9d88-42f5-981b-f97691e2feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:32 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Volume volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 (4e5772ab-abca-4415-8ad7-5a2872a0e133): created successfully Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849650d7-9d88-42f5-981b-f97691e2feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Flow 'volume_create_manager' (4bf1bd5b-571e-495a-8221-4eb163fd1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:32 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-6f0a24d0-f8ef-41ba-94bc-761293b651ba tempest-CreateVolumesFromSnapshotTest-959410084 None] Created volume successfully. Aug 26 19:15:32 devstack sudo[112963]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-09151343-91e7-4123-b3bd-e0c7259012f8" returned: 0 in 0.295s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-09151343-91e7-4123-b3bd-e0c7259012f8" released by "delete_volume" :: held 0.849s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Created reservations ['4d72eac5-0e52-4e74-87e2-585b030cb309', '9fcedf00-4c6f-4372-b68c-d0cc37d4a106', 'd8e241dd-9c28-407e-b516-a2fcc2c728ea', 'a1e82a5d-a24d-4f20-a884-3c220fc7e53f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:32 devstack sudo[112971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:32 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "cinder-f77e31bc-682d-4da6-8d7a-af84ca843eec-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-f77e31bc-682d-4da6-8d7a-af84ca843eec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:33 devstack sudo[112965]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "cinder-quobyte-f77e31bc-682d-4da6-8d7a-af84ca843eec" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 1073741824" returned: 0 in 0.617s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-f77e31bc-682d-4da6-8d7a-af84ca843eec" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d74f54-bc2c-4588-ba89-980ef7a3c106]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:33 devstack sudo[112974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 Aug 26 19:15:33 devstack sudo[112974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:33 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.373s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Deleted volume successfully. Aug 26 19:15:33 devstack sudo[112975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5b942764-dbec-46f0-9b03-f60eab888a50 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-09151343-91e7-4123-b3bd-e0c7259012f8-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:33 devstack sudo[112975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:33 devstack sudo[112974]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73" returned: 0 in 0.347s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bff8200-5265-4aaf-a823-79f19ed58650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6cd016-5624-4d6d-9c87-1251ab775a73', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b673bfa-7598-430a-ade9-e38f9e3abfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 (9d6cd016-5624-4d6d-9c87-1251ab775a73): created successfully Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b673bfa-7598-430a-ade9-e38f9e3abfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (98e6f3da-607b-4a33-ba1a-81f4edab17d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d352696d-2c35-4ef3-8e90-4fc0feb354a4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created volume successfully. Aug 26 19:15:33 devstack sudo[112975]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec" returned: 0 in 0.466s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-4e5772ab-abca-4415-8ad7-5a2872a0e133-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:33 devstack sudo[112983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec Aug 26 19:15:33 devstack sudo[112983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-4e5772ab-abca-4415-8ad7-5a2872a0e133-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-quobyte-4e5772ab-abca-4415-8ad7-5a2872a0e133" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-4e5772ab-abca-4415-8ad7-5a2872a0e133" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39bb28d-1c56-46a7-995e-44b9145fbb91]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:33 devstack sudo[112985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 Aug 26 19:15:33 devstack sudo[112985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:33 devstack sudo[112983]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f77e31bc-682d-4da6-8d7a-af84ca843eec" returned: 0 in 0.320s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-quobyte-f77e31bc-682d-4da6-8d7a-af84ca843eec" released by "delete_volume" :: held 0.848s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:33 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Created reservations ['36f3e1ac-7c8d-46b9-99ec-f534df99af11', 'f163c610-5ea3-4f70-ab25-780a1f7cfa04', 'df509e36-21e0-45ce-a053-4094776ffba8', '319b1d80-9e1d-444c-a414-9e53cc895fa8'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:34 devstack sudo[112990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:34 devstack sudo[112990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:34 devstack sudo[112985]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133" returned: 0 in 0.477s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:34 devstack sudo[112993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133 Aug 26 19:15:34 devstack sudo[112993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:34 devstack sudo[112990]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.351s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Deleted volume successfully. Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1b3f255f-4c6c-4135-aa5b-512c2d551449 tempest-VolumeDependencyTests-1016728560 None] Lock "cinder-f77e31bc-682d-4da6-8d7a-af84ca843eec-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:34 devstack sudo[112993]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4e5772ab-abca-4415-8ad7-5a2872a0e133" returned: 0 in 0.404s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-4e5772ab-abca-4415-8ad7-5a2872a0e133" released by "delete_volume" :: held 0.938s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Created reservations ['449668d7-1283-440e-9587-5a8b526285b7', 'f87c832c-8c9f-4f68-911e-c8e4bed01c17', 'ac6ae3c3-299b-4ff9-b461-a1bb4707ab9f', '72440cd0-6222-464b-9686-a79d7979b20f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:34 devstack sudo[112997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:34 devstack sudo[112997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (d93e1098-1220-4a6a-a6e9-d979942a8dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1bc422-9576-4b5f-b56b-a4dacb59e4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1bc422-9576-4b5f-b56b-a4dacb59e4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371818656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b46ac3-f704-4534-b279-b9155813fb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:35Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b921f9e-8c70-44aa-bfa8-14fef6289666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b921f9e-8c70-44aa-bfa8-14fef6289666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c67500-ef52-4244-a382-edf44317b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c67500-ef52-4244-a382-edf44317b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b46ac3-f704-4534-b279-b9155813fb9f', 'volume_name': 'volume-65b46ac3-f704-4534-b279-b9155813fb9f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956f7803-8913-4514-a90f-113db61afb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956f7803-8913-4514-a90f-113db61afb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a40dfa-c583-4e48-9379-396ca57bc2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume 65b46ac3-f704-4534-b279-b9155813fb9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b46ac3-f704-4534-b279-b9155813fb9f', 'volume_size': 1} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371818656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b46ac3-f704-4534-b279-b9155813fb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:35Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Creating volume 65b46ac3-f704-4534-b279-b9155813fb9f {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:35 devstack sudo[112997]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:35 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.476s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Deleted volume successfully. Aug 26 19:15:35 devstack sudo[113000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f 1073741824 Aug 26 19:15:35 devstack sudo[113000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-979788d4-bc7a-4c49-9d6a-e4bcb81debdf tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-4e5772ab-abca-4415-8ad7-5a2872a0e133-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (fee83665-6f4d-46aa-b9e6-4bc9aaef4144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5665bc-2d4f-47d4-991e-c80ca3c1c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5665bc-2d4f-47d4-991e-c80ca3c1c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-271477552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:36Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec363524-29f9-4cae-a5b4-d98e5314472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec363524-29f9-4cae-a5b4-d98e5314472d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32a4380-1dc7-4c72-bbe2-eaa29a98236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32a4380-1dc7-4c72-bbe2-eaa29a98236b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2', 'volume_name': 'volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25574c76-2fda-4f27-80d9-e17b4dfba301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25574c76-2fda-4f27-80d9-e17b4dfba301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f7d127-c8f4-476b-b93e-d3064acc0425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:35 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume 9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2', 'volume_size': 1} Aug 26 19:15:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-67996cc6-493b-4567-bd29-966395c3659b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-67996cc6-493b-4567-bd29-966395c3659b-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:36 devstack sudo[113000]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f 1073741824" returned: 0 in 0.940s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-quobyte-67996cc6-493b-4567-bd29-966395c3659b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-67996cc6-493b-4567-bd29-966395c3659b" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[44740c61-7e44-4091-a7de-128ee8dbc936]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:36 devstack sudo[113006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f Aug 26 19:15:36 devstack sudo[113006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (6538867a-76e3-4e4d-b3a2-f46cd68bf478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42fea7e-bf23-4cd3-bb24-072706acb69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42fea7e-bf23-4cd3-bb24-072706acb69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262989890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8156f70-b0f3-469e-b19c-d09e4788e73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:36Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b623cf4a-44e7-4c4c-b1a4-4f97b06086ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b623cf4a-44e7-4c4c-b1a4-4f97b06086ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24601bf-9239-4c1b-a4ee-8ce5e3590190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:36 devstack sudo[113007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b Aug 26 19:15:36 devstack sudo[113007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24601bf-9239-4c1b-a4ee-8ce5e3590190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8156f70-b0f3-469e-b19c-d09e4788e73c', 'volume_name': 'volume-c8156f70-b0f3-469e-b19c-d09e4788e73c', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd4f811-bfbb-49ff-a0f6-4b105c357848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd4f811-bfbb-49ff-a0f6-4b105c357848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec5a5cc-e21e-42a7-bbed-37f4b048e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:36 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume c8156f70-b0f3-469e-b19c-d09e4788e73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8156f70-b0f3-469e-b19c-d09e4788e73c', 'volume_size': 1} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:36 devstack sudo[113006]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f" returned: 0 in 0.458s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.071s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-271477552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:36Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Creating volume 9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:36 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:36 devstack sudo[113011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 1073741824 Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a40dfa-c583-4e48-9379-396ca57bc2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b46ac3-f704-4534-b279-b9155813fb9f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:36 devstack sudo[113011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2056f088-1b26-452a-ba62-98c930ea1559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:36 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume volume-65b46ac3-f704-4534-b279-b9155813fb9f (65b46ac3-f704-4534-b279-b9155813fb9f): created successfully Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2056f088-1b26-452a-ba62-98c930ea1559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (d93e1098-1220-4a6a-a6e9-d979942a8dc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:36 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (10950b53-099d-4895-a4d0-772ecf67e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750e3d73-961c-47b3-84c7-a28fc2014330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d3e201e0-4c5a-4227-bb6c-13527649f57e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created volume successfully. Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750e3d73-961c-47b3-84c7-a28fc2014330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7418693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbda8f2f-37e8-4d50-8019-24121f54a186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:37Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7034d007-0824-4b60-ab87-2c8660e3045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack sudo[113007]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7034d007-0824-4b60-ab87-2c8660e3045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f3c764-49cc-4caa-b187-5b6521bde070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f3c764-49cc-4caa-b187-5b6521bde070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbda8f2f-37e8-4d50-8019-24121f54a186', 'volume_name': 'volume-dbda8f2f-37e8-4d50-8019-24121f54a186', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a66e30-0674-48ed-a67a-25dc99e87e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a66e30-0674-48ed-a67a-25dc99e87e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189fad65-0f2f-4835-ac8c-b4c066065d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume dbda8f2f-37e8-4d50-8019-24121f54a186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbda8f2f-37e8-4d50-8019-24121f54a186', 'volume_size': 1} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b" returned: 0 in 0.904s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:37 devstack sudo[113019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b Aug 26 19:15:37 devstack sudo[113019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:37 devstack sudo[113019]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-67996cc6-493b-4567-bd29-966395c3659b" returned: 0 in 0.345s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:37 devstack sudo[113011]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (fdab8ad5-f153-4653-b845-2740c86c2ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e66b107-13fa-4d8e-b234-1ecae7fcb51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-67996cc6-493b-4567-bd29-966395c3659b" released by "delete_volume" :: held 1.391s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 1073741824" returned: 0 in 0.856s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e66b107-13fa-4d8e-b234-1ecae7fcb51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-171073016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f451b33e-96bd-42a2-8933-19c5b98e4fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:38Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57adecb9-a2b3-4f1f-a551-162935e7077c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57adecb9-a2b3-4f1f-a551-162935e7077c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adddc0d-b6c1-4dfe-8dc9-627a410b0396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adddc0d-b6c1-4dfe-8dc9-627a410b0396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f451b33e-96bd-42a2-8933-19c5b98e4fd5', 'volume_name': 'volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea62e61a-db50-4f40-b432-514bb84c169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea62e61a-db50-4f40-b432-514bb84c169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108ded93-eb08-4e7d-976a-223e4a64f686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:37 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume f451b33e-96bd-42a2-8933-19c5b98e4fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5', 'volume_size': 1} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Created reservations ['c8f4a657-fcd9-49ed-81c1-a4fe90e40faa', 'fabb8ae5-1222-4759-b2da-7a782400bc32', 'd617e1c8-8e6b-4f6b-889b-a36d8950a7e1', 'd6d124fa-5ef5-4339-881f-d22b99db5781'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:37 devstack sudo[113024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 Aug 26 19:15:37 devstack sudo[113024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:37 devstack sudo[113026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:37 devstack sudo[113026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:38 devstack sudo[113024]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2" returned: 0 in 0.384s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262989890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8156f70-b0f3-469e-b19c-d09e4788e73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:36Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Creating volume c8156f70-b0f3-469e-b19c-d09e4788e73c {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:38 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f7d127-c8f4-476b-b93e-d3064acc0425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:38 devstack sudo[113026]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:38 devstack sudo[113030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c 1073741824 Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44a37de-6a5d-4019-93ae-01dc0d2fa7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:38 devstack sudo[113030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.351s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Deleted volume successfully. Aug 26 19:15:38 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 (9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2): created successfully Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44a37de-6a5d-4019-93ae-01dc0d2fa7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (fee83665-6f4d-46aa-b9e6-4bc9aaef4144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec5ac3e3-9fe5-4f09-83ab-2e0f134f5fe4 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-67996cc6-493b-4567-bd29-966395c3659b-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-fa1a83f8-55a5-4ccc-9240-4ee2fd2601e0 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created volume successfully. Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-4d8f454b-4f43-4cac-b903-289f50116585-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-4d8f454b-4f43-4cac-b903-289f50116585-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-quobyte-4d8f454b-4f43-4cac-b903-289f50116585" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-4d8f454b-4f43-4cac-b903-289f50116585" acquired by "delete_volume" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be957cf-f194-4c53-8d4e-698be7c59896]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Flow 'volume_create_manager' (facddaaf-f109-4725-8255-92f4608731fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fc50ac-ebcb-4c94-b25e-104bcd4582f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fc50ac-ebcb-4c94-b25e-104bcd4582f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a4820e-29ad-448c-9c76-c2ec08e0c6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b75a8babd47758b54ec6ab655b127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:39Z,use_quota=True,user_id='41b8297d99164b8da22ad356f1276ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:38 devstack sudo[113034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585 Aug 26 19:15:38 devstack sudo[113034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c46e4c2-4b67-45c6-aa03-0ff652b93b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c46e4c2-4b67-45c6-aa03-0ff652b93b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ee61ba-0d72-439c-8800-61a762295033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG cinder.image.glance [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Creating Keystone auth plugin from conf {{(pid=93671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 19:15:38 devstack sudo[113030]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c 1073741824" returned: 0 in 0.715s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:38 devstack sudo[113040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c Aug 26 19:15:38 devstack sudo[113040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:39 devstack sudo[113034]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585" returned: 0 in 0.443s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:39 devstack sudo[113043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585 Aug 26 19:15:39 devstack sudo[113043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ee61ba-0d72-439c-8800-61a762295033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40a4820e-29ad-448c-9c76-c2ec08e0c6fb', 'volume_name': 'volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb', 'volume_size': 1, 'image_id': '563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f448d37512b8d95c44577d3e686be25', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f72b75a8babd47758b54ec6ab655b127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ee2d7718a199c8bd55b163d299e83b0b820ea0a9c3a2621c9c72650c1b8d848749a165f46876d008f0368eef8c31cd2799fae1361fd5370a54b361874630554', 'id': '563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'created_at': datetime.datetime(2026, 8, 26, 17, 15, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 15, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/563ea8e3-6f55-46a8-87df-5b6bfd9dfa97/file', 'properties': {}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef4aa8e-24f9-41a2-bd3c-4b2128df7c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef4aa8e-24f9-41a2-bd3c-4b2128df7c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b314d6-8f57-4415-b499-214d7d943dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:39 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Volume 40a4820e-29ad-448c-9c76-c2ec08e0c6fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb', 'volume_size': 1, 'image_id': '563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f448d37512b8d95c44577d3e686be25', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f72b75a8babd47758b54ec6ab655b127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ee2d7718a199c8bd55b163d299e83b0b820ea0a9c3a2621c9c72650c1b8d848749a165f46876d008f0368eef8c31cd2799fae1361fd5370a54b361874630554', 'id': '563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'created_at': datetime.datetime(2026, 8, 26, 17, 15, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 15, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/563ea8e3-6f55-46a8-87df-5b6bfd9dfa97/file', 'properties': {}}, 'image_service': } Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Trying to clone 40a4820e-29ad-448c-9c76-c2ec08e0c6fb from image 563ea8e3-6f55-46a8-87df-5b6bfd9dfa97 at location (None, [{'url': 'file:///opt/stack/data/glance/images/563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'metadata': {}}]). {{(pid=93671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 19:15:39 devstack sudo[113040]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c" returned: 0 in 0.356s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.057s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7418693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbda8f2f-37e8-4d50-8019-24121f54a186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:37Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Creating volume dbda8f2f-37e8-4d50-8019-24121f54a186 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:39 devstack sudo[113043]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:39 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-4d8f454b-4f43-4cac-b903-289f50116585" returned: 0 in 0.298s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:39 devstack sudo[113047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186 1073741824 Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec5a5cc-e21e-42a7-bbed-37f4b048e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8156f70-b0f3-469e-b19c-d09e4788e73c', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:39 devstack sudo[113047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9f79d9-6652-47d4-9a8e-967ad9dcd5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 19:15:39 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Image download 0.00 MB at 0.00 MB/s Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-4d8f454b-4f43-4cac-b903-289f50116585" released by "delete_volume" :: held 0.838s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:39 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume volume-c8156f70-b0f3-469e-b19c-d09e4788e73c (c8156f70-b0f3-469e-b19c-d09e4788e73c): created successfully Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9f79d9-6652-47d4-9a8e-967ad9dcd5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (6538867a-76e3-4e4d-b3a2-f46cd68bf478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:39 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-42bf4fdf-392f-4cde-bec4-352740c96812 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created volume successfully. Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f621d-e59c-458d-acce-519dc1d786eb]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Created reservations ['095d4ebb-beb0-49ed-ac61-d88ce88c163e', 'baa44bf6-6577-4945-b8f6-652da965e7a4', 'df4c363a-f3c4-49a2-bcb1-c5e577c3f6bb', 'e5c674e8-ef67-4b41-9cd1-e6a35332ca68'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:39 devstack sudo[113083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD Aug 26 19:15:39 devstack sudo[113083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:39 devstack sudo[113088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:39 devstack sudo[113088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-9a55a782-9f37-4bdf-a902-651053878cb6-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-9a55a782-9f37-4bdf-a902-651053878cb6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-quobyte-9a55a782-9f37-4bdf-a902-651053878cb6" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-9a55a782-9f37-4bdf-a902-651053878cb6" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a332b9-99d0-44c5-96b3-4638be03db82]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:40 devstack sudo[113047]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186 1073741824" returned: 0 in 0.723s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:40 devstack sudo[113083]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f4bde6de-842c-4e95-adbf-681db4bab105 tempest-ProjectAdminTests-92851774 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.7907447814941, 'free_capacity_gb': 1774.7907447814941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93671) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD" returned: 0 in 0.629s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:40 devstack sudo[113091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6 Aug 26 19:15:40 devstack sudo[113091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:40 devstack sudo[113097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186 Aug 26 19:15:40 devstack sudo[113097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:40 devstack sudo[113088]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.522s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Deleted volume successfully. Aug 26 19:15:40 devstack sudo[113094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD Aug 26 19:15:40 devstack sudo[113094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3e43d8d9-f86b-44f8-927e-f84a37ca8644 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-4d8f454b-4f43-4cac-b903-289f50116585-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:40 devstack sudo[113097]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186" returned: 0 in 0.354s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.757s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-171073016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f451b33e-96bd-42a2-8933-19c5b98e4fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122e6bc689b841e5b66a428d6af44b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:38Z,use_quota=True,user_id='2c852210de994e74aadcbe3a96a66dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Creating volume f451b33e-96bd-42a2-8933-19c5b98e4fd5 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:40 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189fad65-0f2f-4835-ac8c-b4c066065d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbda8f2f-37e8-4d50-8019-24121f54a186', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:40 devstack sudo[113105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 1073741824 Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499d64c5-0eee-4f6e-bd50-4c534a5397a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:40 devstack sudo[113105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:40 devstack sudo[113091]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6" returned: 0 in 0.670s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:40 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume volume-dbda8f2f-37e8-4d50-8019-24121f54a186 (dbda8f2f-37e8-4d50-8019-24121f54a186): created successfully Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499d64c5-0eee-4f6e-bd50-4c534a5397a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (10950b53-099d-4895-a4d0-772ecf67e22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:40 devstack sudo[113094]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:40 devstack sudo[113111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6 Aug 26 19:15:40 devstack sudo[113111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD" returned: 1 in 0.526s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Temporary image 563ea8e3-6f55-46a8-87df-5b6bfd9dfa97 is fetched for user 41b8297d99164b8da22ad356f1276ed0. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 19:15:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4c28cd2a-ffd4-45c7-b86c-281281a2e55e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created volume successfully. Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7d80ec-0eaf-4ce1-86d1-f361a9dfb9bc]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:40 devstack sudo[113111]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a55a782-9f37-4bdf-a902-651053878cb6" returned: 0 in 0.349s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:40 devstack sudo[113113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD Aug 26 19:15:40 devstack sudo[113113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-9a55a782-9f37-4bdf-a902-651053878cb6" released by "delete_volume" :: held 1.101s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Created reservations ['59c48a48-f1a3-4e32-a112-8629babedf7a', 'f97c46ce-2f59-468c-8058-42b7c2491e6d', '8a63f77d-a9c3-48b7-b8f0-d3fa10092573', 'd7c1390b-bb43-4694-a18a-e3308a19960b'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:41 devstack sudo[113120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:41 devstack sudo[113120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:41 devstack sudo[113105]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 1073741824" returned: 0 in 0.820s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:41 devstack sudo[113113]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD" returned: 0 in 0.586s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:41 devstack sudo[113125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 Aug 26 19:15:41 devstack sudo[113125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:41 devstack sudo[113124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD Aug 26 19:15:41 devstack sudo[113124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:41 devstack sudo[113120]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.321s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Deleted volume successfully. Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0a3bc67f-3412-41ac-a4d9-3b23b043e4a8 tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-9a55a782-9f37-4bdf-a902-651053878cb6-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:41 devstack sudo[113124]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:41 devstack sudo[113125]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5" returned: 0 in 0.346s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a4820e-29ad-448c-9c76-c2ec08e0c6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b75a8babd47758b54ec6ab655b127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:39Z,use_quota=True,user_id='41b8297d99164b8da22ad356f1276ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Creating volume 40a4820e-29ad-448c-9c76-c2ec08e0c6fb {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:41 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:41 devstack sudo[113133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb 1073741824 Aug 26 19:15:41 devstack sudo[113133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108ded93-eb08-4e7d-976a-223e4a64f686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0569abc5-191c-4bab-8881-ee41f162e732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:41 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Volume volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 (f451b33e-96bd-42a2-8933-19c5b98e4fd5): created successfully Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0569abc5-191c-4bab-8881-ee41f162e732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:41 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Flow 'volume_create_manager' (fdab8ad5-f153-4653-b845-2740c86c2ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-783be7b3-e999-45e9-a3d0-416338c6acbb tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created volume successfully. Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-a385298a-8bd3-4d99-b64a-f314bfac61a9-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-a385298a-8bd3-4d99-b64a-f314bfac61a9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:42 devstack sudo[113133]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb 1073741824" returned: 0 in 0.532s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-quobyte-a385298a-8bd3-4d99-b64a-f314bfac61a9" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-a385298a-8bd3-4d99-b64a-f314bfac61a9" acquired by "delete_volume" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d67600a-b5fa-4a7d-a05a-1785ab373649]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:42 devstack sudo[113140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb Aug 26 19:15:42 devstack sudo[113140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-f451b33e-96bd-42a2-8933-19c5b98e4fd5-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-f451b33e-96bd-42a2-8933-19c5b98e4fd5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-quobyte-f451b33e-96bd-42a2-8933-19c5b98e4fd5" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:42 devstack sudo[113139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 Aug 26 19:15:42 devstack sudo[113139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-f451b33e-96bd-42a2-8933-19c5b98e4fd5" acquired by "delete_volume" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e8f183-8048-4a53-9218-26d1cf319ac5]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:42 devstack sudo[113140]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Attempting download of 563ea8e3-6f55-46a8-87df-5b6bfd9dfa97 ((None, [{'url': 'file:///opt/stack/data/glance/images/563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'metadata': {}}])) to volume 40a4820e-29ad-448c-9c76-c2ec08e0c6fb. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 19:15:42 devstack sudo[113143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 Aug 26 19:15:42 devstack sudo[113143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b808560-037e-4c4c-8f1e-33bb8b317fbc]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_wd71wa0p {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:42 devstack sudo[113139]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9" returned: 0 in 0.528s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:42 devstack sudo[113147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_wd71wa0p Aug 26 19:15:42 devstack sudo[113147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:42 devstack sudo[113151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9 Aug 26 19:15:42 devstack sudo[113151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:43 devstack sudo[113143]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5" returned: 0 in 0.519s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:43 devstack sudo[113159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5 Aug 26 19:15:43 devstack sudo[113159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:43 devstack sudo[113147]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_wd71wa0p" returned: 0 in 0.389s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_wd71wa0p {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:43 devstack sudo[113151]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-a385298a-8bd3-4d99-b64a-f314bfac61a9" returned: 0 in 0.326s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-a385298a-8bd3-4d99-b64a-f314bfac61a9" released by "delete_volume" :: held 0.926s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Created reservations ['9b737f82-4aac-4b83-9654-3aa2b37bd2a3', '3cc152c6-3636-429f-8523-f1d19b6e797a', '1066038a-b54e-4316-9e39-9dd7fb3fa964', '1a37f1be-8d9e-4859-afee-eef265889d7a'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:43 devstack sudo[113163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_wd71wa0p Aug 26 19:15:43 devstack sudo[113163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:43 devstack sudo[113165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:43 devstack sudo[113165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-301dc086-4ba2-4b7b-9254-77e044d8a964-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-301dc086-4ba2-4b7b-9254-77e044d8a964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:43 devstack sudo[113159]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-quobyte-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f451b33e-96bd-42a2-8933-19c5b98e4fd5" returned: 0 in 0.400s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-f451b33e-96bd-42a2-8933-19c5b98e4fd5" released by "delete_volume" :: held 0.990s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-quobyte-301dc086-4ba2-4b7b-9254-77e044d8a964" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-301dc086-4ba2-4b7b-9254-77e044d8a964" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Deleting offline snapshot 301dc086-4ba2-4b7b-9254-77e044d8a964 of volume 3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:15:43 devstack sudo[113163]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] snapshot_file for this snap is: volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_wd71wa0p" returned: 1 in 0.446s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_wd71wa0p' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcf1a17-9498-4873-bf68-2f05eee7a657]: (4, 'raw') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04a410-7dbd-4fdc-8131-bd32897b81e3]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created reservations ['acb6fbfb-007b-4588-9707-333c540dc930', '2959ca1c-f106-4584-8928-66d0f77f5905', '91bcc199-ec31-44c7-92ce-9b4f5da62d06', '38610429-f0fe-47f1-be75-bdddf556d5e3'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:43 devstack sudo[113171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD Aug 26 19:15:43 devstack sudo[113171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:43 devstack sudo[113172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 Aug 26 19:15:43 devstack sudo[113172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:43 devstack sudo[113165]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.461s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:43 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Deleted volume successfully. Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-72a7bb37-b234-4866-b7bf-419baed0b72c tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-a385298a-8bd3-4d99-b64a-f314bfac61a9-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:43 devstack sudo[113176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:43 devstack sudo[113176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:44 devstack sudo[113171]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:44 devstack sudo[113172]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964" returned: 0 in 0.569s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:15:44 devstack sudo[113180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD Aug 26 19:15:44 devstack sudo[113180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:44 devstack sudo[113176]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[906ff3d9-811a-492d-a5fc-aa8ae3c8f730]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.362s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:44 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Deleted volume successfully. Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-afc32d22-0b66-49ff-aa3a-c1c1cf04bfac tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-f451b33e-96bd-42a2-8933-19c5b98e4fd5-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:44 devstack sudo[113187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 Aug 26 19:15:44 devstack sudo[113187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:44 devstack sudo[113180]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD" returned: 1 in 0.394s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD' failed. Not Retrying. {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] 563ea8e3-6f55-46a8-87df-5b6bfd9dfa97 was raw, converting to qcow2 {{(pid=93671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:44 devstack sudo[113192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb Aug 26 19:15:44 devstack sudo[113192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:44 devstack sudo[113187]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" returned: 0 in 0.439s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:44 devstack sudo[113197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 Aug 26 19:15:44 devstack sudo[113197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-dbda8f2f-37e8-4d50-8019-24121f54a186-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-dbda8f2f-37e8-4d50-8019-24121f54a186-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-quobyte-dbda8f2f-37e8-4d50-8019-24121f54a186" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-dbda8f2f-37e8-4d50-8019-24121f54a186" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4cfef4-92d6-41b6-bd03-571d6f3d7e77]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:45 devstack sudo[113202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186 Aug 26 19:15:45 devstack sudo[113202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:45 devstack sudo[113192]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb" returned: 0 in 0.634s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_563ea8e3-6f55-46a8-87df-5b6bfd9dfa97_l71gbo83devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:15:45 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:45 devstack sudo[113209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb 1G Aug 26 19:15:45 devstack sudo[113209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:45 devstack sudo[113197]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964" returned: 0 in 0.518s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:45 devstack sudo[113211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964 Aug 26 19:15:45 devstack sudo[113211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:45 devstack sudo[113202]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (f2aaf3b3-be8f-4812-9515-03c1434fae2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3424a419-c5ea-4be3-9b13-45238ea47967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186" returned: 0 in 0.592s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:45 devstack sudo[113211]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:45 devstack sudo[113209]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5.301dc086-4ba2-4b7b-9254-77e044d8a964" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3424a419-c5ea-4be3-9b13-45238ea47967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869626523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd1377e-f007-49b1-bb6f-697955e68275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:45Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:45 devstack sudo[113222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186 Aug 26 19:15:45 devstack sudo[113222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ee4b23-f86b-4d65-ad90-ac112c9d70ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ee4b23-f86b-4d65-ad90-ac112c9d70ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c69469d-8f62-4b30-a5f6-88050fb00347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c69469d-8f62-4b30-a5f6-88050fb00347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd1377e-f007-49b1-bb6f-697955e68275', 'volume_name': 'volume-dbd1377e-f007-49b1-bb6f-697955e68275', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f059a1-eaa3-4307-a3fd-e282ed881784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f059a1-eaa3-4307-a3fd-e282ed881784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c5383d-28c2-49d9-b1f2-1572e1db1e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:45 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Volume dbd1377e-f007-49b1-bb6f-697955e68275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd1377e-f007-49b1-bb6f-697955e68275', 'volume_size': 1} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869626523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd1377e-f007-49b1-bb6f-697955e68275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:45Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Creating volume dbd1377e-f007-49b1-bb6f-697955e68275 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:45 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb 1G" returned: 0 in 0.487s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Downloaded image 563ea8e3-6f55-46a8-87df-5b6bfd9dfa97 ((None, [{'url': 'file:///opt/stack/data/glance/images/563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'metadata': {}}])) to volume 40a4820e-29ad-448c-9c76-c2ec08e0c6fb successfully. {{(pid=93671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Temporary image 563ea8e3-6f55-46a8-87df-5b6bfd9dfa97 for user 41b8297d99164b8da22ad356f1276ed0 is deleted. {{(pid=93671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.volume_utils [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Marking volume 40a4820e-29ad-448c-9c76-c2ec08e0c6fb as bootable. {{(pid=93671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 19:15:45 devstack sudo[113224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 1073741824 Aug 26 19:15:45 devstack sudo[113224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-301dc086-4ba2-4b7b-9254-77e044d8a964" released by "_delete_snapshot" :: held 2.086s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Copying metadata from image 563ea8e3-6f55-46a8-87df-5b6bfd9dfa97 to 40a4820e-29ad-448c-9c76-c2ec08e0c6fb. {{(pid=93671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Creating volume glance metadata for volume 40a4820e-29ad-448c-9c76-c2ec08e0c6fb backed by image 563ea8e3-6f55-46a8-87df-5b6bfd9dfa97 with: {'image_id': '563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4f448d37512b8d95c44577d3e686be25', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" released by "delete_snapshot" :: held 2.125s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b314d6-8f57-4415-b499-214d7d943dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb', 'volume_size': 1, 'image_id': '563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f448d37512b8d95c44577d3e686be25', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f72b75a8babd47758b54ec6ab655b127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ee2d7718a199c8bd55b163d299e83b0b820ea0a9c3a2621c9c72650c1b8d848749a165f46876d008f0368eef8c31cd2799fae1361fd5370a54b361874630554', 'id': '563ea8e3-6f55-46a8-87df-5b6bfd9dfa97', 'created_at': datetime.datetime(2026, 8, 26, 17, 15, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 17, 15, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/563ea8e3-6f55-46a8-87df-5b6bfd9dfa97/file', 'properties': {}}, 'image_service': }' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b138d5-cc6f-46ce-8e5d-ea7f0bd37c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Created reservations ['d01f1bb5-5622-480e-8b1a-6a274918abdf', 'a2e3a28e-9c4d-49ee-a5eb-b2c415ac2bd9', 'b0efb2c4-2fe8-4d67-b022-77354821cba6', '39429779-66c4-43e4-948d-7af6292b1eb2'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:45 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Volume volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb (40a4820e-29ad-448c-9c76-c2ec08e0c6fb): created successfully Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b138d5-cc6f-46ce-8e5d-ea7f0bd37c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Flow 'volume_create_manager' (facddaaf-f109-4725-8255-92f4608731fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:45 devstack sudo[113222]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbda8f2f-37e8-4d50-8019-24121f54a186" returned: 0 in 0.282s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f7bae23a-f5ad-4923-adf3-6d73a6dc94b3 tempest-VolumeImageDependencyTests-697121901 None] Created volume successfully. Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-dbda8f2f-37e8-4d50-8019-24121f54a186" released by "delete_volume" :: held 0.934s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Delete snapshot completed successfully. Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b6ed7fe8-987e-4369-b7d6-b53020fd7cfe tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-301dc086-4ba2-4b7b-9254-77e044d8a964-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created reservations ['23c4a451-6385-4461-81a4-980e7cd207e6', '1bda1e13-5f9e-4126-80b2-3c4d657eaa11', '8a00d70b-6bed-47fe-bee4-8939ee7bf2c6', '72e57388-ce2c-4e02-833b-686fe9d06a77'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:46 devstack sudo[113231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:46 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:46 devstack sudo[113224]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 1073741824" returned: 0 in 0.487s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:46 devstack sudo[113233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 Aug 26 19:15:46 devstack sudo[113233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:46 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Deleted volume successfully. Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-306baa8e-2525-4a31-995e-6cf71fa87a56 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-dbda8f2f-37e8-4d50-8019-24121f54a186-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Acquiring lock "cinder-40a4820e-29ad-448c-9c76-c2ec08e0c6fb-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Lock "cinder-40a4820e-29ad-448c-9c76-c2ec08e0c6fb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Acquiring lock "cinder-quobyte-40a4820e-29ad-448c-9c76-c2ec08e0c6fb" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Lock "cinder-quobyte-40a4820e-29ad-448c-9c76-c2ec08e0c6fb" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f38ea4-96a5-4fea-af7f-07b3988af5d2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:46 devstack sudo[113233]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275" returned: 0 in 0.290s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c5383d-28c2-49d9-b1f2-1572e1db1e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd1377e-f007-49b1-bb6f-697955e68275', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2839220f-f9af-4689-acaf-43adff066cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:46 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Volume volume-dbd1377e-f007-49b1-bb6f-697955e68275 (dbd1377e-f007-49b1-bb6f-697955e68275): created successfully Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2839220f-f9af-4689-acaf-43adff066cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (f2aaf3b3-be8f-4812-9515-03c1434fae2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9fff3127-153a-42dd-94ac-216c1c3e4315 tempest-ProjectMemberTests-1720022270 None] Created volume successfully. Aug 26 19:15:46 devstack sudo[113237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb Aug 26 19:15:46 devstack sudo[113237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "cinder-quobyte-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" acquired by "delete_volume" :: waited 0.017s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:46 devstack sudo[113237]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb" returned: 0 in 0.404s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3432aced-6967-42d6-a0be-8286628cb9fe]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:46 devstack sudo[113242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb Aug 26 19:15:46 devstack sudo[113242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:46 devstack sudo[113243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 Aug 26 19:15:46 devstack sudo[113243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:47 devstack sudo[113242]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-40a4820e-29ad-448c-9c76-c2ec08e0c6fb" returned: 0 in 0.267s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-c8156f70-b0f3-469e-b19c-d09e4788e73c-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Lock "cinder-quobyte-40a4820e-29ad-448c-9c76-c2ec08e0c6fb" released by "delete_volume" :: held 0.731s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-c8156f70-b0f3-469e-b19c-d09e4788e73c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-quobyte-c8156f70-b0f3-469e-b19c-d09e4788e73c" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Created reservations ['dd3ab016-f890-4de4-ba4c-f50ad19c5a4d', '4d6cb748-55b9-4fd4-b2c9-59037f9ff439', 'aefc26cd-9bb6-4aa1-bacb-ee1168e7bd24', '961aec4a-951f-4e1a-9c13-48c27323bd3e'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-c8156f70-b0f3-469e-b19c-d09e4788e73c" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:47 devstack sudo[113243]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[26328e5a-7e37-4a5d-8804-15709ea0cfac]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" returned: 0 in 0.455s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:47 devstack sudo[113251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5 Aug 26 19:15:47 devstack sudo[113251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:47 devstack sudo[113253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:47 devstack sudo[113253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:47 devstack sudo[113250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c Aug 26 19:15:47 devstack sudo[113250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:47 devstack sudo[113251]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" returned: 0 in 0.382s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-quobyte-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5" released by "delete_volume" :: held 0.900s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:47 devstack sudo[113253]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.343s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:47 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Deleted volume successfully. Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8e59b7ba-04f6-4139-9dfd-aef8f2e25d63 tempest-VolumeImageDependencyTests-697121901 None] Lock "cinder-40a4820e-29ad-448c-9c76-c2ec08e0c6fb-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:47 devstack sudo[113250]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c" returned: 0 in 0.523s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Created reservations ['54c821fa-7b04-43fc-92c5-28ef8494f79b', '6d799e9a-ddb9-472c-ae3f-98a694c4785c', '746be9ee-b206-43c8-8382-77754d66e3d6', '1da3047e-caf2-4f15-a54e-66110ba82802'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:47 devstack sudo[113262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c Aug 26 19:15:47 devstack sudo[113262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:47 devstack sudo[113264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:47 devstack sudo[113264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:48 devstack sudo[113262]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c8156f70-b0f3-469e-b19c-d09e4788e73c" returned: 0 in 0.356s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-c8156f70-b0f3-469e-b19c-d09e4788e73c" released by "delete_volume" :: held 0.931s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Creating offline snapshot bc8679a7-ad19-4e5a-9c67-7910bcb73a83 of volume dbd1377e-f007-49b1-bb6f-697955e68275 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5f98a-bcb1-4a9b-a238-9803367c6615]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created reservations ['4245795f-3a37-4863-952b-7a6e07afe269', '1ec23594-1b1b-44a2-8d17-4d40a6a7dce1', '53437082-75aa-483e-a03d-95c5a9aabdb5', '3b08917b-f70b-4eee-aa07-ee64762cc0e8'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:48 devstack sudo[113264]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.393s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Deleted volume successfully. Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3211db66-4977-4839-ad22-c4b8aa01823d tempest-CreateVolumesFromSnapshotTest-959410084 None] Lock "cinder-3510fa77-6ca1-45aa-a5b5-2a3f49b578f5-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:48 devstack sudo[113267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 Aug 26 19:15:48 devstack sudo[113267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:48 devstack sudo[113270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:48 devstack sudo[113270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:48 devstack sudo[113270]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.262s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:48 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Deleted volume successfully. Aug 26 19:15:48 devstack sudo[113267]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275" returned: 0 in 0.460s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:48 devstack sudo[113280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 1G Aug 26 19:15:48 devstack sudo[113280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a9af50ec-a81b-4a1b-beda-30d92cdd84b4 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-c8156f70-b0f3-469e-b19c-d09e4788e73c-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:49 devstack sudo[113280]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 1G" returned: 0 in 0.509s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbd1377e-f007-49b1-bb6f-697955e68275 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:49 devstack sudo[113290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbd1377e-f007-49b1-bb6f-697955e68275 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 Aug 26 19:15:49 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-quobyte-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2" acquired by "delete_volume" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:49 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbd1377e-f007-49b1-bb6f-697955e68275 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83" returned: 0 in 0.421s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:49 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 is being set with open permissions: ugo+rw Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[60893c86-2b9e-483b-93a0-6470372e7174]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:49 devstack sudo[113296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 Aug 26 19:15:49 devstack sudo[113296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:49 devstack sudo[113297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 Aug 26 19:15:49 devstack sudo[113297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:49 devstack sudo[113296]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83" returned: 0 in 0.331s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:50 devstack sudo[113301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.info Aug 26 19:15:50 devstack sudo[113301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:50 devstack sudo[113297]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2" returned: 0 in 0.529s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:50 devstack sudo[113307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2 Aug 26 19:15:50 devstack sudo[113307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:50 devstack sudo[113301]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.info" returned: 0 in 0.292s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:50 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.info is being set with open permissions: ugo+rw Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:50 devstack sudo[113310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.info Aug 26 19:15:50 devstack sudo[113310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:50 devstack sudo[113307]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2" returned: 0 in 0.346s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2" released by "delete_volume" :: held 0.949s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created reservations ['6838c066-b8d3-4e4b-9fa6-1c8d3559bf63', '706e16e0-94a2-4bbc-93df-a2534817c25f', '775fa8c3-6a82-4b57-99a5-1d8a16b8e5df', '087c3cab-60bf-4f1f-870b-f4c2cee7620b'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:50 devstack sudo[113310]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.info" returned: 0 in 0.373s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:50 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8e227c69-73b3-4538-88ff-666c06617e69 tempest-ProjectMemberTests-1720022270 None] Create snapshot completed successfully Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:50 devstack sudo[113314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:50 devstack sudo[113314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:51 devstack sudo[113314]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.318s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:51 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Deleted volume successfully. Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f356321c-7f2d-4123-94f3-f290d7f6efee tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-9a28f19f-b6a7-4de1-bb6c-9f6c91e1b5c2-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-bc8679a7-ad19-4e5a-9c67-7910bcb73a83-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-bc8679a7-ad19-4e5a-9c67-7910bcb73a83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-dbd1377e-f007-49b1-bb6f-697955e68275" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-dbd1377e-f007-49b1-bb6f-697955e68275" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-bc8679a7-ad19-4e5a-9c67-7910bcb73a83" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-bc8679a7-ad19-4e5a-9c67-7910bcb73a83" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Deleting offline snapshot bc8679a7-ad19-4e5a-9c67-7910bcb73a83 of volume dbd1377e-f007-49b1-bb6f-697955e68275 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] snapshot_file for this snap is: volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[45746875-5be2-4524-b150-2f9f770eb6f4]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:51 devstack sudo[113317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 Aug 26 19:15:51 devstack sudo[113317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-65b46ac3-f704-4534-b279-b9155813fb9f-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-65b46ac3-f704-4534-b279-b9155813fb9f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-quobyte-65b46ac3-f704-4534-b279-b9155813fb9f" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-65b46ac3-f704-4534-b279-b9155813fb9f" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:51 devstack sudo[113317]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83" returned: 0 in 0.547s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbd1377e-f007-49b1-bb6f-697955e68275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[51965669-95f5-44bd-9418-a02324912800]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf01441-b903-4f8b-9b40-de4bde3a9aa9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:52 devstack sudo[113322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f Aug 26 19:15:52 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:52 devstack sudo[113323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 Aug 26 19:15:52 devstack sudo[113323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:52 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f" returned: 0 in 0.515s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:52 devstack sudo[113323]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275" returned: 0 in 0.512s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:52 devstack sudo[113333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f Aug 26 19:15:52 devstack sudo[113333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:52 devstack sudo[113334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 Aug 26 19:15:52 devstack sudo[113334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (9971c497-3521-4cce-8d1c-8f4b54e244a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6e85f5-7a30-45ab-aabd-13827a0e17a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6e85f5-7a30-45ab-aabd-13827a0e17a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343778179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a879e3-a79c-4ecb-86d3-4ec7f7b86a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:53Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bed18f-4ee4-4c6e-b489-ce2c78dcd76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bed18f-4ee4-4c6e-b489-ce2c78dcd76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c194440-4aaf-4e47-bbb2-fc486bcbb202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c194440-4aaf-4e47-bbb2-fc486bcbb202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a879e3-a79c-4ecb-86d3-4ec7f7b86a03', 'volume_name': 'volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814a2091-452e-4660-97f8-d55288a25182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814a2091-452e-4660-97f8-d55288a25182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db697c8-5507-4651-884f-383a22ce305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:52 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Volume 85a879e3-a79c-4ecb-86d3-4ec7f7b86a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03', 'volume_size': 1} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343778179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a879e3-a79c-4ecb-86d3-4ec7f7b86a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:53Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Creating volume 85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:52 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:52 devstack sudo[113337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 1073741824 Aug 26 19:15:52 devstack sudo[113337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:52 devstack sudo[113333]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-65b46ac3-f704-4534-b279-b9155813fb9f" returned: 0 in 0.320s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-65b46ac3-f704-4534-b279-b9155813fb9f" released by "delete_volume" :: held 0.927s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:52 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created reservations ['b389682e-b863-489e-97ea-e4f5cfb0477b', 'f438e9f8-0041-4ccd-bbcc-2bfe3cd6827f', '6beb8818-abd2-4531-b4be-57c9b29ad43d', '9831186c-1dc3-45fc-9acf-030ee021fd09'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:53 devstack sudo[113334]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83" returned: 0 in 0.439s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:53 devstack sudo[113344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83 Aug 26 19:15:53 devstack sudo[113344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-9d6cd016-5624-4d6d-9c87-1251ab775a73-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:53 devstack sudo[113349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:53 devstack sudo[113349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-9d6cd016-5624-4d6d-9c87-1251ab775a73-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "cinder-quobyte-9d6cd016-5624-4d6d-9c87-1251ab775a73" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-9d6cd016-5624-4d6d-9c87-1251ab775a73" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b29d5e-505c-4d78-a843-9a6ac6ce1ee9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:53 devstack sudo[113344]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275.bc8679a7-ad19-4e5a-9c67-7910bcb73a83" returned: 0 in 0.389s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-bc8679a7-ad19-4e5a-9c67-7910bcb73a83" released by "_delete_snapshot" :: held 2.049s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:53 devstack sudo[113352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 Aug 26 19:15:53 devstack sudo[113352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-dbd1377e-f007-49b1-bb6f-697955e68275" released by "delete_snapshot" :: held 2.093s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:53 devstack sudo[113349]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:53 devstack sudo[113337]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.395s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 1073741824" returned: 0 in 0.750s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:53 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Deleted volume successfully. Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0710199e-345a-4962-b892-ce7f54945e7e tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-65b46ac3-f704-4534-b279-b9155813fb9f-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Created reservations ['5f067e92-40cc-4a63-b8d7-adeda9f972c9', '1593bb45-c910-4e20-8924-424c633eeec9', '9bad21cc-0b53-449c-8b81-a2c0aaeb5894', '0f6e82e5-2c52-4830-b0d3-aa03a9609ec3'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:53 devstack sudo[113355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 Aug 26 19:15:53 devstack sudo[113355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:53 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Delete snapshot completed successfully. Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-db4bb5e4-8598-439a-bf53-06b830fa736a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-bc8679a7-ad19-4e5a-9c67-7910bcb73a83-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:53 devstack sudo[113352]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73" returned: 0 in 0.463s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:53 devstack sudo[113360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73 Aug 26 19:15:53 devstack sudo[113360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:53 devstack sudo[113355]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" returned: 0 in 0.318s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db697c8-5507-4651-884f-383a22ce305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788b956c-09a2-4d78-a20c-fd44ac19e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:53 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Volume volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 (85a879e3-a79c-4ecb-86d3-4ec7f7b86a03): created successfully Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788b956c-09a2-4d78-a20c-fd44ac19e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:53 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (9971c497-3521-4cce-8d1c-8f4b54e244a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:54 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-87e00cdb-b007-4981-a202-c0d69dbeeff8 tempest-ProjectReaderTests-1699822213 None] Created volume successfully. Aug 26 19:15:54 devstack sudo[113360]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-9d6cd016-5624-4d6d-9c87-1251ab775a73" returned: 0 in 0.294s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-quobyte-9d6cd016-5624-4d6d-9c87-1251ab775a73" released by "delete_volume" :: held 0.816s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Created reservations ['3944f226-727c-4105-8f88-142ee16f7d81', '8a0e43ce-70a3-4687-a8d8-cbe7a54697a9', 'c6b5795a-0429-4eef-aa54-2097994ae04d', '27135a8a-0694-4689-8ef7-a5fd06f88b18'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:54 devstack sudo[113364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:54 devstack sudo[113364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:54 devstack sudo[113364]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.288s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:54 devstack sudo[113367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:54 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Deleted volume successfully. Aug 26 19:15:54 devstack sudo[113367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ed79a669-216a-4570-9d46-c9183c716804 tempest-CreateVolumesFromSourceVolumeTest-158792898 None] Lock "cinder-9d6cd016-5624-4d6d-9c87-1251ab775a73-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-dbd1377e-f007-49b1-bb6f-697955e68275-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-dbd1377e-f007-49b1-bb6f-697955e68275-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-dbd1377e-f007-49b1-bb6f-697955e68275" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-dbd1377e-f007-49b1-bb6f-697955e68275" acquired by "delete_volume" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:54 devstack sudo[113367]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.351s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0592e-88cd-436c-b91b-ecad8ac80c2b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:55 devstack sudo[113370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 Aug 26 19:15:55 devstack sudo[113370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Creating offline snapshot 289ff4bc-4e86-4e58-baae-af16920205ac of volume 85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089ad85-0768-4c96-a7f2-7ff2d9b33570]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:55 devstack sudo[113374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 Aug 26 19:15:55 devstack sudo[113374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:55 devstack sudo[113370]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275" returned: 0 in 0.551s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:55 devstack sudo[113379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275 Aug 26 19:15:55 devstack sudo[113379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" returned: 0 in 0.543s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:55 devstack sudo[113374]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:55 devstack sudo[113385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac 1G Aug 26 19:15:55 devstack sudo[113385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:55 devstack sudo[113379]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-dbd1377e-f007-49b1-bb6f-697955e68275" returned: 0 in 0.485s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-dbd1377e-f007-49b1-bb6f-697955e68275" released by "delete_volume" :: held 1.171s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Created reservations ['874df377-e3b7-45a0-ad30-1a08c0cbd679', 'c979a667-f810-4af2-8e50-7d7c7aa79a0f', '33d2bf56-72a5-4405-a52c-22a5c07581be', 'bc31037f-295b-4ba9-91dc-bcbc35b9b42a'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:56 devstack sudo[113392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:15:56 devstack sudo[113392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:56 devstack sudo[113385]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac 1G" returned: 0 in 0.749s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:56 devstack sudo[113394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac Aug 26 19:15:56 devstack sudo[113394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:56 devstack sudo[113392]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.353s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:15:56 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Deleted volume successfully. Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-2aa733e2-b385-4284-8351-0c6d75717849 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-dbd1377e-f007-49b1-bb6f-697955e68275-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:15:56 devstack sudo[113394]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac" returned: 0 in 0.350s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:56 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac is being set with open permissions: ugo+rw Aug 26 19:15:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:56 devstack sudo[113400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac Aug 26 19:15:56 devstack sudo[113400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:57 devstack sudo[113400]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac" returned: 0 in 0.333s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:57 devstack sudo[113403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.info Aug 26 19:15:57 devstack sudo[113403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:57 devstack sudo[113403]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.info" returned: 0 in 0.323s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:57 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.info is being set with open permissions: ugo+rw Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:57 devstack sudo[113407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.info Aug 26 19:15:57 devstack sudo[113407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (6f505083-5fbc-4303-9e1f-ef41918f768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f60f4f-4596-4d8c-9a6e-1d438d3d287c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f60f4f-4596-4d8c-9a6e-1d438d3d287c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615410379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d22b8a9-b317-4a6e-9ff0-1993a771ff77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:58Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31e09df-a46a-472b-ac4e-2d67a36005df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31e09df-a46a-472b-ac4e-2d67a36005df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50fc5fa-cabd-4339-bfd3-0436023d071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50fc5fa-cabd-4339-bfd3-0436023d071e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d22b8a9-b317-4a6e-9ff0-1993a771ff77', 'volume_name': 'volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab533c7-dcee-44ea-8828-4b8678420225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab533c7-dcee-44ea-8828-4b8678420225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0cea3e-1ae2-4843-b23d-4528a219d47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:57 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Volume 7d22b8a9-b317-4a6e-9ff0-1993a771ff77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77', 'volume_size': 1} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:57 devstack sudo[113407]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.info" returned: 0 in 0.301s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615410379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d22b8a9-b317-4a6e-9ff0-1993a771ff77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:58Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Creating volume 7d22b8a9-b317-4a6e-9ff0-1993a771ff77 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:57 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:57 devstack sudo[113410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 1073741824 Aug 26 19:15:57 devstack sudo[113410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:57 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ffb90fec-f7c2-4429-9ab6-f91ebb003fd2 tempest-ProjectReaderTests-1699822213 None] Create snapshot completed successfully Aug 26 19:15:58 devstack sudo[113410]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 1073741824" returned: 0 in 0.571s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:58 devstack sudo[113417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 Aug 26 19:15:58 devstack sudo[113417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-289ff4bc-4e86-4e58-baae-af16920205ac-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-289ff4bc-4e86-4e58-baae-af16920205ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-289ff4bc-4e86-4e58-baae-af16920205ac" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-289ff4bc-4e86-4e58-baae-af16920205ac" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Deleting offline snapshot 289ff4bc-4e86-4e58-baae-af16920205ac of volume 85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] snapshot_file for this snap is: volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0663bce7-6721-4d5b-b9f1-688ab60a868c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:58 devstack sudo[113417]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" returned: 0 in 0.420s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:15:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0cea3e-1ae2-4843-b23d-4528a219d47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:59 devstack sudo[113420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f556bc-6200-4ed3-b2b2-83d3f677c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:59 devstack sudo[113420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Flow 'volume_create_manager' (88d51359-5232-4d04-8519-1084b7410e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aed7983-6d8d-4ecc-af25-343a9b7fcf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aed7983-6d8d-4ecc-af25-343a9b7fcf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083d69f1-ea77-4e14-9aa9-937e0f1c2193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4e518693b34a13ab9573d0af707047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:59Z,use_quota=True,user_id='6a704f249dbf4c85bb45769f949ee7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a503e5-b421-49af-9dea-e23495155c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a503e5-b421-49af-9dea-e23495155c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa079acc-527c-4494-84bb-5db0ede73e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa079acc-527c-4494-84bb-5db0ede73e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083d69f1-ea77-4e14-9aa9-937e0f1c2193', 'volume_name': 'volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a392ba5-c47b-4bdb-a515-c517a6ed9e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a392ba5-c47b-4bdb-a515-c517a6ed9e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f241e42-c12a-4455-8e2c-a7c00dee8f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:15:59 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Volume 083d69f1-ea77-4e14-9aa9-937e0f1c2193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193', 'volume_size': 1} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083d69f1-ea77-4e14-9aa9-937e0f1c2193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4e518693b34a13ab9573d0af707047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:15:59Z,use_quota=True,user_id='6a704f249dbf4c85bb45769f949ee7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Creating volume 083d69f1-ea77-4e14-9aa9-937e0f1c2193 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:15:59 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:59 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Volume volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 (7d22b8a9-b317-4a6e-9ff0-1993a771ff77): created successfully Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f556bc-6200-4ed3-b2b2-83d3f677c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (6f505083-5fbc-4303-9e1f-ef41918f768b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:15:59 devstack sudo[113422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 1073741824 Aug 26 19:15:59 devstack sudo[113422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:59 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-29a0af7c-b094-480f-b24f-ca1d7e872635 tempest-ProjectMemberTests-1720022270 None] Created volume successfully. Aug 26 19:15:59 devstack sudo[113420]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac" returned: 0 in 0.423s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[30059a68-31b2-437b-b508-bbc3e21b88fd]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:59 devstack sudo[113428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 Aug 26 19:15:59 devstack sudo[113428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:59 devstack sudo[113422]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 1073741824" returned: 0 in 0.518s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:59 devstack sudo[113437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 Aug 26 19:15:59 devstack sudo[113437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:15:59 devstack sudo[113428]: pam_unix(sudo:session): session closed for user root Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" returned: 0 in 0.433s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:15:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:15:59 devstack sudo[113439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac Aug 26 19:15:59 devstack sudo[113439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:00 devstack sudo[113437]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193" returned: 0 in 0.322s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f241e42-c12a-4455-8e2c-a7c00dee8f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ac878d-d589-4e81-a0a8-cfce48b97652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:00 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Volume volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 (083d69f1-ea77-4e14-9aa9-937e0f1c2193): created successfully Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ac878d-d589-4e81-a0a8-cfce48b97652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Flow 'volume_create_manager' (88d51359-5232-4d04-8519-1084b7410e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:00 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c74ab622-1488-4581-b648-8ad01c4b7639 tempest-CinderUnicodeTest-498813867 None] Created volume successfully. Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Creating offline snapshot 641e8319-aa5e-454d-ae53-a57aa05aafc2 of volume 7d22b8a9-b317-4a6e-9ff0-1993a771ff77 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a055687-1d41-4085-bc99-92e29009de00]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:00 devstack sudo[113439]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac" returned: 0 in 0.449s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:00 devstack sudo[113446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac Aug 26 19:16:00 devstack sudo[113446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:00 devstack sudo[113445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 Aug 26 19:16:00 devstack sudo[113445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:00 devstack sudo[113446]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03.289ff4bc-4e86-4e58-baae-af16920205ac" returned: 0 in 0.291s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-289ff4bc-4e86-4e58-baae-af16920205ac" released by "_delete_snapshot" :: held 1.733s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" released by "delete_snapshot" :: held 1.774s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:00 devstack sudo[113445]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" returned: 0 in 0.395s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:00 devstack sudo[113453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 1G Aug 26 19:16:00 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Created reservations ['a85d3892-9ec2-41fc-b9d7-3c58ce0b2353', '114b79c1-bea4-4edf-848e-1d1636c23af5', '4fb5f06c-244e-4066-b205-6e076cb4aa25', '6c207402-edc1-4090-9e51-f3a8ec50e602'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:00 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Delete snapshot completed successfully. Aug 26 19:16:00 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-1bbf6519-2257-4061-9459-5e0fb24f12b4 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-289ff4bc-4e86-4e58-baae-af16920205ac-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:01 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 1G" returned: 0 in 0.474s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:01 devstack sudo[113459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 Aug 26 19:16:01 devstack sudo[113459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" acquired by "delete_volume" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[03edec86-2ac1-443b-be55-27991951d788]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:01 devstack sudo[113459]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2" returned: 0 in 0.456s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:01 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 is being set with open permissions: ugo+rw Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:01 devstack sudo[113465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 Aug 26 19:16:01 devstack sudo[113465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:01 devstack sudo[113464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 Aug 26 19:16:01 devstack sudo[113464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:01 devstack sudo[113465]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2" returned: 0 in 0.379s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:01 devstack sudo[113464]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" returned: 0 in 0.500s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:01 devstack sudo[113472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.info Aug 26 19:16:01 devstack sudo[113472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:02 devstack sudo[113473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03 Aug 26 19:16:02 devstack sudo[113473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Flow 'volume_create_manager' (81b22e41-4bef-4a4c-8e56-41440593df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b65a878-cab3-4196-a395-70e2fc2187dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b65a878-cab3-4196-a395-70e2fc2187dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1474489820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4e518693b34a13ab9573d0af707047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:02Z,use_quota=True,user_id='6a704f249dbf4c85bb45769f949ee7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb1af8e-5d79-4866-8598-fbf5f87e7a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb1af8e-5d79-4866-8598-fbf5f87e7a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff32bd3c-19c4-4012-bb19-8618bc44c722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff32bd3c-19c4-4012-bb19-8618bc44c722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff', 'volume_name': 'volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389d085a-a1dd-4d2f-bae9-f366d181a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389d085a-a1dd-4d2f-bae9-f366d181a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74363288-4586-4be5-a09f-d0ad9d38ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:02 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Volume fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff', 'volume_size': 1} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:02 devstack sudo[113472]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.info" returned: 0 in 0.383s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:02 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.info is being set with open permissions: ugo+rw Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:02 devstack sudo[113477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.info Aug 26 19:16:02 devstack sudo[113477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:02 devstack sudo[113473]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" returned: 0 in 0.474s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03" released by "delete_volume" :: held 1.054s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Created reservations ['e127fab4-ba6f-4d8b-973d-39604d1347ca', '0e212700-684d-4234-9c3e-31ec0e4a9a1b', '4450fd0d-03ab-45dd-9ae5-fb8fbe367b06', 'fabcd63a-333c-4619-b0bb-813c803bbac7'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:02 devstack sudo[113477]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.info" returned: 0 in 0.319s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:02 devstack sudo[113481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:02 devstack sudo[113481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1474489820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4e518693b34a13ab9573d0af707047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:02Z,use_quota=True,user_id='6a704f249dbf4c85bb45769f949ee7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Creating volume fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:02 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:02 devstack sudo[113483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff 1073741824 Aug 26 19:16:02 devstack sudo[113483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:02 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0852bfd9-465e-49f0-a51e-67d9eaa09aea tempest-ProjectMemberTests-1720022270 None] Create snapshot completed successfully Aug 26 19:16:02 devstack sudo[113481]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.327s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:02 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:02 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Deleted volume successfully. Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-89d7eb5f-2f32-46fb-bedf-96c5948f0e26 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-85a879e3-a79c-4ecb-86d3-4ec7f7b86a03-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:03 devstack sudo[113483]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff 1073741824" returned: 0 in 0.571s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:03 devstack sudo[113490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff Aug 26 19:16:03 devstack sudo[113490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-641e8319-aa5e-454d-ae53-a57aa05aafc2-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-641e8319-aa5e-454d-ae53-a57aa05aafc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-641e8319-aa5e-454d-ae53-a57aa05aafc2" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-641e8319-aa5e-454d-ae53-a57aa05aafc2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Deleting offline snapshot 641e8319-aa5e-454d-ae53-a57aa05aafc2 of volume 7d22b8a9-b317-4a6e-9ff0-1993a771ff77 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] snapshot_file for this snap is: volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0e34ce-f7aa-49b4-8924-9c2be685c3e8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:03 devstack sudo[113490]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" returned: 0 in 0.362s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74363288-4586-4be5-a09f-d0ad9d38ac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e58577-4404-42ee-9090-6a8cc5471b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:03 devstack sudo[113492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 Aug 26 19:16:03 devstack sudo[113492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:03 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Volume volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff (fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff): created successfully Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e58577-4404-42ee-9090-6a8cc5471b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:03 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Flow 'volume_create_manager' (81b22e41-4bef-4a4c-8e56-41440593df75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-87841376-46e8-4463-a581-039c584c9367 tempest-CinderUnicodeTest-498813867 None] Created volume successfully. Aug 26 19:16:04 devstack sudo[113492]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2" returned: 0 in 0.512s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b07180f-b4ca-4895-98eb-f08c25a0e50a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (deaf398b-445f-4275-8db6-fa06f3e6fbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34289463-ca93-4de7-8320-af9f47be4f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34289463-ca93-4de7-8320-af9f47be4f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770103451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aea5eb8-7c56-432d-9003-96a70918ee95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:04Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:04 devstack sudo[113498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 Aug 26 19:16:04 devstack sudo[113498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e76f6f-05a5-4985-9f7f-cfcc415dd3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e76f6f-05a5-4985-9f7f-cfcc415dd3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56da5937-fce5-4a42-971a-a4f63b3039c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56da5937-fce5-4a42-971a-a4f63b3039c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aea5eb8-7c56-432d-9003-96a70918ee95', 'volume_name': 'volume-0aea5eb8-7c56-432d-9003-96a70918ee95', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd03fe7-99fd-4fe7-a708-42b2028798c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd03fe7-99fd-4fe7-a708-42b2028798c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ea993d-6476-4fe3-bb51-12e7fa08bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:04 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Volume 0aea5eb8-7c56-432d-9003-96a70918ee95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aea5eb8-7c56-432d-9003-96a70918ee95', 'volume_size': 1} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770103451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aea5eb8-7c56-432d-9003-96a70918ee95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:04Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Creating volume 0aea5eb8-7c56-432d-9003-96a70918ee95 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:04 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:04 devstack sudo[113500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 1073741824 Aug 26 19:16:04 devstack sudo[113500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:04 devstack sudo[113498]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" returned: 0 in 0.518s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:04 devstack sudo[113507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 Aug 26 19:16:04 devstack sudo[113507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:04 devstack sudo[113500]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 1073741824" returned: 0 in 0.570s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=239,cinder:INSERT=79,cinder:UPDATE=282,cinder:DELETE=26 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:16:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:05 devstack sudo[113514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 Aug 26 19:16:05 devstack sudo[113514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:05 devstack sudo[113507]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2" returned: 0 in 0.469s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:05 devstack sudo[113516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2 Aug 26 19:16:05 devstack sudo[113516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:05 devstack sudo[113514]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95" returned: 0 in 0.321s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.744s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:UPDATE=313,cinder:SELECT=200,cinder:DELETE=28,cinder:INSERT=80 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ea993d-6476-4fe3-bb51-12e7fa08bc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aea5eb8-7c56-432d-9003-96a70918ee95', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb57153-5d47-4479-b09c-e5f804c9b5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Creating offline snapshot 65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 of volume fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:05 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Volume volume-0aea5eb8-7c56-432d-9003-96a70918ee95 (0aea5eb8-7c56-432d-9003-96a70918ee95): created successfully Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb57153-5d47-4479-b09c-e5f804c9b5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (deaf398b-445f-4275-8db6-fa06f3e6fbc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef126680-ca40-44d6-93de-d076659dce10]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:05 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-20d00f4c-27fe-464d-8dc6-7cb8d6cedae2 tempest-ProjectReaderTests-1699822213 None] Created volume successfully. Aug 26 19:16:05 devstack sudo[113516]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77.641e8319-aa5e-454d-ae53-a57aa05aafc2" returned: 0 in 0.366s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-641e8319-aa5e-454d-ae53-a57aa05aafc2" released by "_delete_snapshot" :: held 2.033s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:05 devstack sudo[113520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff Aug 26 19:16:05 devstack sudo[113520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" released by "delete_snapshot" :: held 2.071s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Created reservations ['a654368e-168b-4792-b339-47ea61d3650a', '70a03b00-6bf5-4e62-b6b7-fae9e85e7fbf', 'e25d7906-3a41-4714-901d-a55d32c93958', 'fe250484-1d86-4217-933a-379b96a0fd46'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:05 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Delete snapshot completed successfully. Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-53ef0397-b7ec-445d-ad1e-b6051e9e7d6a tempest-ProjectMemberTests-1720022270 None] Lock "cinder-641e8319-aa5e-454d-ae53-a57aa05aafc2-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:05 devstack sudo[113520]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" returned: 0 in 0.400s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:05 devstack sudo[113525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 1G Aug 26 19:16:05 devstack sudo[113525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:06 devstack sudo[113525]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 1G" returned: 0 in 0.471s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:06 devstack sudo[113531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 Aug 26 19:16:06 devstack sudo[113531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:06 devstack sudo[113531]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748" returned: 0 in 0.349s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:06 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 is being set with open permissions: ugo+rw Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:06 devstack sudo[113536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 Aug 26 19:16:06 devstack sudo[113536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-7d22b8a9-b317-4a6e-9ff0-1993a771ff77-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Lock "cinder-7d22b8a9-b317-4a6e-9ff0-1993a771ff77-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" acquired by "delete_volume" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f237e0-bbc5-4c6e-bb71-7eae79b6ac5f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:07 devstack sudo[113536]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748" returned: 0 in 0.357s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:07 devstack sudo[113538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 Aug 26 19:16:07 devstack sudo[113538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:07 devstack sudo[113541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.info Aug 26 19:16:07 devstack sudo[113541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:07 devstack sudo[113541]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.info" returned: 0 in 0.293s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:07 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.info is being set with open permissions: ugo+rw Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:07 devstack sudo[113538]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:07 devstack sudo[113548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.info Aug 26 19:16:07 devstack sudo[113548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" returned: 0 in 0.453s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:07 devstack sudo[113550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77 Aug 26 19:16:07 devstack sudo[113550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:07 devstack sudo[113548]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.info" returned: 0 in 0.348s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:07 devstack sudo[113550]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.295s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" returned: 0 in 0.350s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Creating offline snapshot ef00312a-1af5-48a6-a39e-418318ee1b86 of volume 0aea5eb8-7c56-432d-9003-96a70918ee95 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-7d22b8a9-b317-4a6e-9ff0-1993a771ff77" released by "delete_volume" :: held 0.897s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[28603223-5a4a-4870-aeb6-13c4a6f3c329]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:07 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-5fde5888-9475-422c-8d8a-8b5608466a0f tempest-CinderUnicodeTest-498813867 None] Create snapshot completed successfully Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Created reservations ['e84a8497-fd8c-4fcf-a409-44d808022b1a', '592a98d1-9eee-42e5-b846-c588206c5fa8', '608f24a6-e084-4222-bf65-e6037e967282', '53b584c6-962c-45fe-8932-2c1c0ca5fa83'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:07 devstack sudo[113556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 Aug 26 19:16:07 devstack sudo[113556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:08 devstack sudo[113558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:08 devstack sudo[113558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:08 devstack sudo[113556]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95" returned: 0 in 0.424s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:08 devstack sudo[113558]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.271s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:08 devstack sudo[113564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 1G Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:08 devstack sudo[113564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:08 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Deleted volume successfully. Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-61f3cf97-a30b-4ba1-8873-1d45f9b7ffef tempest-ProjectMemberTests-1720022270 None] Lock "cinder-7d22b8a9-b317-4a6e-9ff0-1993a771ff77-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:08 devstack sudo[113564]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 1G" returned: 0 in 0.419s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aea5eb8-7c56-432d-9003-96a70918ee95 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:08 devstack sudo[113570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aea5eb8-7c56-432d-9003-96a70918ee95 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 Aug 26 19:16:08 devstack sudo[113570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Acquiring lock "cinder-65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Lock "cinder-65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Acquiring lock "cinder-quobyte-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Lock "cinder-quobyte-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Acquiring lock "cinder-quobyte-65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Lock "cinder-quobyte-65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Deleting offline snapshot 65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 of volume fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] snapshot_file for this snap is: volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56dc0d9-783a-49a0-952e-1506f1ba8636]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:08 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:09 devstack sudo[113570]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0aea5eb8-7c56-432d-9003-96a70918ee95 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86" returned: 0 in 0.387s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:09 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 is being set with open permissions: ugo+rw Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:09 devstack sudo[113573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 Aug 26 19:16:09 devstack sudo[113573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:09 devstack sudo[113576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 Aug 26 19:16:09 devstack sudo[113576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:09 devstack sudo[113576]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86" returned: 0 in 0.337s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:09 devstack sudo[113573]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748" returned: 0 in 0.534s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:09 devstack sudo[113583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.info Aug 26 19:16:09 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcef21d5-5806-4291-8c3f-bcb081057f34]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:09 devstack sudo[113585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff Aug 26 19:16:09 devstack sudo[113585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:09 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.info" returned: 0 in 0.324s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:09 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.info is being set with open permissions: ugo+rw Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:09 devstack sudo[113588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.info Aug 26 19:16:09 devstack sudo[113588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:09 devstack sudo[113585]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" returned: 0 in 0.483s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:10 devstack sudo[113594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 Aug 26 19:16:10 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (8a93491b-7c3c-4297-9723-f49c7b1df638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7096ff-6033-4e05-bdac-407f6987ca17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:10 devstack sudo[113588]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7096ff-6033-4e05-bdac-407f6987ca17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1911995909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:10Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9956ad1b-e350-42a4-b35b-30ccfa61382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9956ad1b-e350-42a4-b35b-30ccfa61382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71a1d13-37f6-4bf3-9a0a-63b82d6da5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71a1d13-37f6-4bf3-9a0a-63b82d6da5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80', 'volume_name': 'volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578fbf77-cc5b-4ed5-a219-1035e4c0a15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578fbf77-cc5b-4ed5-a219-1035e4c0a15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bceba6-d08e-4ec6-9b1f-2d7912885e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:10 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Volume 5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80', 'volume_size': 1} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.info" returned: 0 in 0.355s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1911995909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:10Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Creating volume 5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:10 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:10 devstack sudo[113597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 1073741824 Aug 26 19:16:10 devstack sudo[113597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:10 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-637e81c8-208a-4ac1-a5ff-2c2fb83a6d43 tempest-ProjectReaderTests-1699822213 None] Create snapshot completed successfully Aug 26 19:16:10 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748" returned: 0 in 0.417s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:10 devstack sudo[113605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748 Aug 26 19:16:10 devstack sudo[113605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:10 devstack sudo[113597]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 1073741824" returned: 0 in 0.490s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:10 devstack sudo[113605]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff.65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748" returned: 0 in 0.304s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:10 devstack sudo[113609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 Aug 26 19:16:10 devstack sudo[113609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Lock "cinder-quobyte-65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748" released by "_delete_snapshot" :: held 1.907s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-ef00312a-1af5-48a6-a39e-418318ee1b86-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Lock "cinder-quobyte-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" released by "delete_snapshot" :: held 1.950s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-ef00312a-1af5-48a6-a39e-418318ee1b86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-0aea5eb8-7c56-432d-9003-96a70918ee95" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-0aea5eb8-7c56-432d-9003-96a70918ee95" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-ef00312a-1af5-48a6-a39e-418318ee1b86" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-ef00312a-1af5-48a6-a39e-418318ee1b86" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Deleting offline snapshot ef00312a-1af5-48a6-a39e-418318ee1b86 of volume 0aea5eb8-7c56-432d-9003-96a70918ee95 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] snapshot_file for this snap is: volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Created reservations ['086e2e40-66eb-4f83-969d-48c499336e8e', '59c16040-9ade-4c92-8e2f-f9888946c7da', 'cbd0bd19-9ca8-4ed8-a55a-1448ccf5c4d5', '0a047fc8-e721-45d9-9fb9-2a0073f20d9b'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d37c81d-829d-4e2e-a2a8-ca204e167360]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:11 devstack sudo[113609]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" returned: 0 in 0.353s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bceba6-d08e-4ec6-9b1f-2d7912885e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe49882-b241-40c8-b2ed-d45eef40d1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:11 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Volume volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 (5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80): created successfully Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe49882-b241-40c8-b2ed-d45eef40d1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (8a93491b-7c3c-4297-9723-f49c7b1df638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:11 devstack sudo[113612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 Aug 26 19:16:11 devstack sudo[113612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Delete snapshot completed successfully. Aug 26 19:16:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4ca19092-3b29-47b2-917f-02a65d27f02e tempest-ProjectMemberTests-1720022270 None] Created volume successfully. Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9a988a71-7d2a-403b-8302-ea9820fbd8a8 tempest-CinderUnicodeTest-498813867 None] Lock "cinder-65d92ac5-54c5-4bbf-b4ba-3d1a01f6a748-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:11 devstack sudo[113612]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86" returned: 0 in 0.438s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aea5eb8-7c56-432d-9003-96a70918ee95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe0c7dc-138e-4abf-9b72-5bc370255101]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:11 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 Aug 26 19:16:11 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:11 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95" returned: 0 in 0.408s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:11 devstack sudo[113622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 Aug 26 19:16:11 devstack sudo[113622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Acquiring lock "cinder-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Lock "cinder-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Creating offline snapshot 5228e173-e4a5-4daa-89b8-58dbe53d7131 of volume 5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Acquiring lock "cinder-quobyte-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b828f49-b2e7-407a-8883-7db6b339c987]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Lock "cinder-quobyte-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" acquired by "delete_volume" :: waited 0.053s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4728058f-cbc2-456f-b4fc-3050c141d887]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:12 devstack sudo[113624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 Aug 26 19:16:12 devstack sudo[113624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:12 devstack sudo[113622]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86" returned: 0 in 0.585s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:12 devstack sudo[113628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff Aug 26 19:16:12 devstack sudo[113628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:12 devstack sudo[113630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86 Aug 26 19:16:12 devstack sudo[113630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:12 devstack sudo[113624]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" returned: 0 in 0.492s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:12 devstack sudo[113641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 1G Aug 26 19:16:12 devstack sudo[113641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:12 devstack sudo[113630]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95.ef00312a-1af5-48a6-a39e-418318ee1b86" returned: 0 in 0.361s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:12 devstack sudo[113628]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" returned: 0 in 0.525s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-ef00312a-1af5-48a6-a39e-418318ee1b86" released by "_delete_snapshot" :: held 1.948s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-0aea5eb8-7c56-432d-9003-96a70918ee95" released by "delete_snapshot" :: held 1.998s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:12 devstack sudo[113644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff Aug 26 19:16:12 devstack sudo[113644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:12 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Created reservations ['d7268a36-d157-4281-8e35-6ac8d037bbf8', '95c47cec-04ab-48b6-b6cb-d32167468fec', 'd814ccd6-d2d1-4251-bd5a-787539c2de76', '5b8f24bd-29bd-4fa9-8440-5ccfbbd57de6'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Delete snapshot completed successfully. Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-7948e89c-ddaf-4afd-b54c-444fc4a49f98 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-ef00312a-1af5-48a6-a39e-418318ee1b86-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:13 devstack sudo[113644]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Lock "cinder-quobyte-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff" released by "delete_volume" :: held 0.947s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:13 devstack sudo[113641]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 1G" returned: 0 in 0.542s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Created reservations ['cf758a94-d37c-4b3b-b4b5-b8a3cf9b2666', '039df456-e9b5-4198-b12a-82ff99877b6a', 'f3cbf518-cc7f-47f3-abf5-56eafc22dd51', 'b00746f3-249d-4250-8a5b-66620f7b4ac1'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:13 devstack sudo[113652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 Aug 26 19:16:13 devstack sudo[113652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:13 devstack sudo[113654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:13 devstack sudo[113654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:13 devstack sudo[113652]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131" returned: 0 in 0.344s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:13 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 is being set with open permissions: ugo+rw Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:13 devstack sudo[113660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 Aug 26 19:16:13 devstack sudo[113660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:13 devstack sudo[113654]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.303s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Deleted volume successfully. Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-283ae5d5-1c7c-456d-8caf-dacbc30f430a tempest-CinderUnicodeTest-498813867 None] Lock "cinder-fa75f2f7-8587-4d7b-ae4a-a49fb8fc66ff-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:13 devstack sudo[113660]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131" returned: 0 in 0.269s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:13 devstack sudo[113664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.info Aug 26 19:16:13 devstack sudo[113664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-0aea5eb8-7c56-432d-9003-96a70918ee95-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-0aea5eb8-7c56-432d-9003-96a70918ee95-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-0aea5eb8-7c56-432d-9003-96a70918ee95" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-0aea5eb8-7c56-432d-9003-96a70918ee95" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:14 devstack sudo[113664]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.info" returned: 0 in 0.321s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:14 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.info is being set with open permissions: ugo+rw Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[864e9eb7-07c8-45f0-a18f-c74bc94854e1]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:14 devstack sudo[113667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.info Aug 26 19:16:14 devstack sudo[113667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:14 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 Aug 26 19:16:14 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Acquiring lock "cinder-083d69f1-ea77-4e14-9aa9-937e0f1c2193-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Lock "cinder-083d69f1-ea77-4e14-9aa9-937e0f1c2193-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:14 devstack sudo[113667]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.info" returned: 0 in 0.307s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Acquiring lock "cinder-quobyte-083d69f1-ea77-4e14-9aa9-937e0f1c2193" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d024216f-7f0b-4e53-b07c-ba9cfbbe0d8d tempest-ProjectMemberTests-1720022270 None] Create snapshot completed successfully Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Lock "cinder-quobyte-083d69f1-ea77-4e14-9aa9-937e0f1c2193" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba69e9a-7c64-4a0f-aa70-0211f51adc1a]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:14 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95" returned: 0 in 0.507s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:14 devstack sudo[113676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95 Aug 26 19:16:14 devstack sudo[113676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:14 devstack sudo[113673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 Aug 26 19:16:14 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:15 devstack sudo[113676]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0aea5eb8-7c56-432d-9003-96a70918ee95" returned: 0 in 0.302s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-0aea5eb8-7c56-432d-9003-96a70918ee95" released by "delete_volume" :: held 0.906s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:15 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193" returned: 0 in 0.441s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:15 devstack sudo[113684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193 Aug 26 19:16:15 devstack sudo[113684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Created reservations ['d102cc83-4d49-4817-9f6d-4ffaa3caeadf', '64cb7ac1-9549-4c42-b9a8-8c817463b279', 'ab7f3c64-55ed-40eb-a784-f23bbb52b1b3', 'ef696ec7-12ae-4595-a46f-3247665a356d'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:15 devstack sudo[113686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:15 devstack sudo[113686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:15 devstack sudo[113684]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-083d69f1-ea77-4e14-9aa9-937e0f1c2193" returned: 0 in 0.365s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Lock "cinder-quobyte-083d69f1-ea77-4e14-9aa9-937e0f1c2193" released by "delete_volume" :: held 0.865s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:15 devstack sudo[113686]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.336s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Deleted volume successfully. Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Created reservations ['889fbd31-5fbe-4ddd-8b6c-d9294cd2c784', 'b3abfa35-1f2a-4e33-abc3-9011040130be', '093a7799-7ae6-4aed-bf62-da9d28868c5e', '4afe45d9-a9ea-4d77-8d4c-6a29b5b2463f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-ec39c767-ba8a-4165-a5f6-c0a2970512e8 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-0aea5eb8-7c56-432d-9003-96a70918ee95-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-5228e173-e4a5-4daa-89b8-58dbe53d7131-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-5228e173-e4a5-4daa-89b8-58dbe53d7131-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-5228e173-e4a5-4daa-89b8-58dbe53d7131" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-5228e173-e4a5-4daa-89b8-58dbe53d7131" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Deleting offline snapshot 5228e173-e4a5-4daa-89b8-58dbe53d7131 of volume 5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] snapshot_file for this snap is: volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c8a636-4ce7-471c-accc-f7701d6f312c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:15 devstack sudo[113691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:15 devstack sudo[113691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (b27d485c-ff2a-482c-b578-682a4ed4a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5907a48b-2632-4f11-9b0f-589d16c3e53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:15 devstack sudo[113690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 Aug 26 19:16:15 devstack sudo[113690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5907a48b-2632-4f11-9b0f-589d16c3e53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384360875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a10fc9-cd44-4420-9418-22679473d51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:16Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1bb33d-45ea-4c96-a990-67c9fe91305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1bb33d-45ea-4c96-a990-67c9fe91305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df7988-64cc-4a54-9448-dbb8dec9d4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df7988-64cc-4a54-9448-dbb8dec9d4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a10fc9-cd44-4420-9418-22679473d51d', 'volume_name': 'volume-47a10fc9-cd44-4420-9418-22679473d51d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e044d597-a965-4316-a7c8-82652cb1f57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e044d597-a965-4316-a7c8-82652cb1f57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00fe637-4e0f-4b58-b6e0-0e5f53f8560b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:16 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Volume 47a10fc9-cd44-4420-9418-22679473d51d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a10fc9-cd44-4420-9418-22679473d51d', 'volume_size': 1} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-384360875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a10fc9-cd44-4420-9418-22679473d51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:16Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Creating volume 47a10fc9-cd44-4420-9418-22679473d51d {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:16 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:16 devstack sudo[113694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d 1073741824 Aug 26 19:16:16 devstack sudo[113694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:16 devstack sudo[113691]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.356s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:16 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Deleted volume successfully. Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-03a8d7f1-dea5-4360-a2a9-ed19a858b5fc tempest-CinderUnicodeTest-498813867 None] Lock "cinder-083d69f1-ea77-4e14-9aa9-937e0f1c2193-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:16 devstack sudo[113690]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131" returned: 0 in 0.490s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8be427b-28e4-4885-baf0-04059d763abc]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:16 devstack sudo[113703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 Aug 26 19:16:16 devstack sudo[113703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:16 devstack sudo[113694]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d 1073741824" returned: 0 in 0.553s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:16 devstack sudo[113706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d Aug 26 19:16:16 devstack sudo[113706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:16 devstack sudo[113703]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" returned: 0 in 0.451s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:16 devstack sudo[113711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 Aug 26 19:16:16 devstack sudo[113711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:16 devstack sudo[113706]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d" returned: 0 in 0.301s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00fe637-4e0f-4b58-b6e0-0e5f53f8560b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a10fc9-cd44-4420-9418-22679473d51d', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3025b646-5efe-4f7f-aff0-cf2656cb768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:16 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Volume volume-47a10fc9-cd44-4420-9418-22679473d51d (47a10fc9-cd44-4420-9418-22679473d51d): created successfully Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3025b646-5efe-4f7f-aff0-cf2656cb768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:16 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (b27d485c-ff2a-482c-b578-682a4ed4a926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-94f1efde-8c70-4751-b52a-31309567c5e2 tempest-ProjectReaderTests-1699822213 None] Created volume successfully. Aug 26 19:16:17 devstack sudo[113711]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131" returned: 0 in 0.453s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:17 devstack sudo[113717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131 Aug 26 19:16:17 devstack sudo[113717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:17 devstack sudo[113717]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80.5228e173-e4a5-4daa-89b8-58dbe53d7131" returned: 0 in 0.307s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-5228e173-e4a5-4daa-89b8-58dbe53d7131" released by "_delete_snapshot" :: held 1.817s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" released by "delete_snapshot" :: held 1.852s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:17 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Created reservations ['15ac8a56-1cda-4625-aa32-d0a370354e24', 'd102e70c-c37a-461f-b055-120577086881', 'e46e5cb5-54fd-4ed5-acba-d5fa0b6fbfff', '207f7b76-9e9b-4a77-be05-e02adb20bf7a'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Delete snapshot completed successfully. Aug 26 19:16:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f0a02848-3cb6-4cdb-8dc5-7d77a0977d77 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-5228e173-e4a5-4daa-89b8-58dbe53d7131-delete_snapshot" released by "delete_snapshot" :: held 2.061s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Lock "cinder-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" acquired by "delete_volume" :: waited 0.030s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[af232593-6b8e-4a57-ba04-c3d69af959fa]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:18 devstack sudo[113721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 Aug 26 19:16:18 devstack sudo[113721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Creating offline snapshot 780386ea-887c-4472-8c44-0e4a7d5ce4d3 of volume 47a10fc9-cd44-4420-9418-22679473d51d {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[686b6637-11e3-4e56-9955-d6a044b2214b]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:18 devstack sudo[113723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d Aug 26 19:16:18 devstack sudo[113723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:18 devstack sudo[113721]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" returned: 0 in 0.552s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:18 devstack sudo[113728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80 Aug 26 19:16:18 devstack sudo[113728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:18 devstack sudo[113723]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d" returned: 0 in 0.483s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:18 devstack sudo[113733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 1G Aug 26 19:16:18 devstack sudo[113733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:19 devstack sudo[113728]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" returned: 0 in 0.383s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80" released by "delete_volume" :: held 1.053s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Created reservations ['73c63ab9-4c16-4ac5-9a01-c03ea6f3e9be', 'ec03ee10-d4cc-4cb7-8224-36ce418193ac', 'fe2ad81f-53c0-4f0c-853a-4b32f46b1515', '98407ab4-ceb3-4747-8123-29e3113427ae'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:19 devstack sudo[113739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:19 devstack sudo[113739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:19 devstack sudo[113733]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 1G" returned: 0 in 0.572s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a10fc9-cd44-4420-9418-22679473d51d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:19 devstack sudo[113742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a10fc9-cd44-4420-9418-22679473d51d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 Aug 26 19:16:19 devstack sudo[113742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:19 devstack sudo[113739]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.334s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Deleted volume successfully. Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-465e6368-66c8-493e-a771-045b1f04674e tempest-ProjectMemberTests-1720022270 None] Lock "cinder-5f9c3e45-54df-4ae8-ba9f-a4d40ef2ec80-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:19 devstack sudo[113742]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a10fc9-cd44-4420-9418-22679473d51d -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3" returned: 0 in 0.411s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:19 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 is being set with open permissions: ugo+rw Aug 26 19:16:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:19 devstack sudo[113748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 Aug 26 19:16:19 devstack sudo[113748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:20 devstack sudo[113748]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3" returned: 0 in 0.340s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:20 devstack sudo[113751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.info Aug 26 19:16:20 devstack sudo[113751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:20 devstack sudo[113751]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.info" returned: 0 in 0.410s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:20 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.info is being set with open permissions: ugo+rw Aug 26 19:16:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:20 devstack sudo[113754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.info Aug 26 19:16:20 devstack sudo[113754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:20 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:20 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (dabca7a2-95a0-4104-aa38-5109bcbc039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b92fcd0-0064-4d4e-9fe2-d33c5bc054ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:21 devstack sudo[113754]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.info" returned: 0 in 0.300s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b92fcd0-0064-4d4e-9fe2-d33c5bc054ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440259278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60ae3fc-0afb-4d50-9f35-75f3c09ba344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:21Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa7151a-9e84-499e-9554-d390825f137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa7151a-9e84-499e-9554-d390825f137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250b84b0-18fa-4066-9ea4-91772be16dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250b84b0-18fa-4066-9ea4-91772be16dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60ae3fc-0afb-4d50-9f35-75f3c09ba344', 'volume_name': 'volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ff4ff8-d56b-4235-8c86-421563fcde05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ff4ff8-d56b-4235-8c86-421563fcde05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848f5f79-841b-4fee-a128-d4db462b7c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:21 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Volume f60ae3fc-0afb-4d50-9f35-75f3c09ba344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344', 'volume_size': 1} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440259278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60ae3fc-0afb-4d50-9f35-75f3c09ba344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:21Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Creating volume f60ae3fc-0afb-4d50-9f35-75f3c09ba344 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:21 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:21 devstack sudo[113757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 1073741824 Aug 26 19:16:21 devstack sudo[113757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:21 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-bf672d69-0aa5-4903-8781-5ec912827dc9 tempest-ProjectReaderTests-1699822213 None] Create snapshot completed successfully Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-780386ea-887c-4472-8c44-0e4a7d5ce4d3-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Lock "cinder-780386ea-887c-4472-8c44-0e4a7d5ce4d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-47a10fc9-cd44-4420-9418-22679473d51d" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-47a10fc9-cd44-4420-9418-22679473d51d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-780386ea-887c-4472-8c44-0e4a7d5ce4d3" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-780386ea-887c-4472-8c44-0e4a7d5ce4d3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Deleting offline snapshot 780386ea-887c-4472-8c44-0e4a7d5ce4d3 of volume 47a10fc9-cd44-4420-9418-22679473d51d {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:21 devstack sudo[113757]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] snapshot_file for this snap is: volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 1073741824" returned: 0 in 0.642s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb7741f-08fb-4d01-a692-e3bd41ead2fa]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:21 devstack sudo[113764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 Aug 26 19:16:21 devstack sudo[113764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:21 devstack sudo[113763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 Aug 26 19:16:21 devstack sudo[113763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:22 devstack sudo[113764]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" returned: 0 in 0.375s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848f5f79-841b-4fee-a128-d4db462b7c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b45553c-2509-4a21-8bdb-ab8cd947882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:22 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Volume volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 (f60ae3fc-0afb-4d50-9f35-75f3c09ba344): created successfully Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b45553c-2509-4a21-8bdb-ab8cd947882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (dabca7a2-95a0-4104-aa38-5109bcbc039c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-70bd99f4-caf5-4ab7-a90a-6b0a5266969a tempest-ProjectMemberTests-1720022270 None] Created volume successfully. Aug 26 19:16:22 devstack sudo[113763]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3" returned: 0 in 0.637s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a10fc9-cd44-4420-9418-22679473d51d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fcb7f3-2c4f-4da9-b54b-8dfbdafaf2e4]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:22 devstack sudo[113772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d Aug 26 19:16:22 devstack sudo[113772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:22 devstack sudo[113772]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d" returned: 0 in 0.378s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:22 devstack sudo[113777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 Aug 26 19:16:22 devstack sudo[113777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:23 devstack sudo[113777]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3" returned: 0 in 0.509s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:23 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3 Aug 26 19:16:23 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Creating offline snapshot 8fe295aa-f31d-4385-b684-23cd2eaf539c of volume f60ae3fc-0afb-4d50-9f35-75f3c09ba344 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8835d0b9-cece-4b92-bace-f795250b2df2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:23 devstack sudo[113785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 Aug 26 19:16:23 devstack sudo[113785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:23 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d.780386ea-887c-4472-8c44-0e4a7d5ce4d3" returned: 0 in 0.352s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-780386ea-887c-4472-8c44-0e4a7d5ce4d3" released by "_delete_snapshot" :: held 2.024s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-47a10fc9-cd44-4420-9418-22679473d51d" released by "delete_snapshot" :: held 2.056s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Created reservations ['6503fef5-80b9-4285-9bd8-e0532acf36c6', '0b75fcb5-2da7-4333-ba68-83e37104ea1b', 'c15a35c8-109b-450c-82fa-c707ac73218a', '61c603a9-8e43-488a-b735-9efdae3b56ed'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:23 devstack sudo[113785]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" returned: 0 in 0.550s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:23 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Delete snapshot completed successfully. Aug 26 19:16:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-5cea3288-1825-4084-8181-37f21d8ccd0d tempest-ProjectReaderTests-1699822213 None] Lock "cinder-780386ea-887c-4472-8c44-0e4a7d5ce4d3-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:24 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c 1G Aug 26 19:16:24 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:24 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c 1G" returned: 0 in 0.535s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:24 devstack sudo[113799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c Aug 26 19:16:24 devstack sudo[113799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:24 devstack sudo[113799]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c" returned: 0 in 0.415s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:24 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c is being set with open permissions: ugo+rw Aug 26 19:16:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:24 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-47a10fc9-cd44-4420-9418-22679473d51d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:24 devstack sudo[113805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c Aug 26 19:16:24 devstack sudo[113805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-47a10fc9-cd44-4420-9418-22679473d51d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-47a10fc9-cd44-4420-9418-22679473d51d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-47a10fc9-cd44-4420-9418-22679473d51d" acquired by "delete_volume" :: waited 0.016s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ea8784-e043-4779-88b9-0ad31191c0d7]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:25 devstack sudo[113807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d Aug 26 19:16:25 devstack sudo[113807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:25 devstack sudo[113805]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:25 devstack sudo[113810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.info Aug 26 19:16:25 devstack sudo[113810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:25 devstack sudo[113807]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d" returned: 0 in 0.425s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:25 devstack sudo[113815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d Aug 26 19:16:25 devstack sudo[113815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:25 devstack sudo[113810]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.info" returned: 0 in 0.333s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:25 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.info is being set with open permissions: ugo+rw Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:25 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.info Aug 26 19:16:25 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:25 devstack sudo[113815]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-47a10fc9-cd44-4420-9418-22679473d51d" returned: 0 in 0.327s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-47a10fc9-cd44-4420-9418-22679473d51d" released by "delete_volume" :: held 0.838s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:25 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.info" returned: 0 in 0.305s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-133450fe-ce31-4b7e-a3da-fe4cf4641507 tempest-ProjectMemberTests-1720022270 None] Create snapshot completed successfully Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Created reservations ['27ece2f8-247f-4719-81f5-95e605a1b8e8', '98f5a1fe-2ccb-4d61-9c24-1ad434778051', '33363084-8ee9-4b74-8743-3049aa4355c8', '67463340-655c-4cbd-b224-6d5b2f2c66c6'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:26 devstack sudo[113822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:26 devstack sudo[113822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:26 devstack sudo[113822]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.374s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Deleted volume successfully. Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-8fe295aa-f31d-4385-b684-23cd2eaf539c-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-8fe295aa-f31d-4385-b684-23cd2eaf539c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-fbc58ec3-13c6-4284-9f6b-a7a60397a465 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-47a10fc9-cd44-4420-9418-22679473d51d-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-8fe295aa-f31d-4385-b684-23cd2eaf539c" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-8fe295aa-f31d-4385-b684-23cd2eaf539c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Deleting offline snapshot 8fe295aa-f31d-4385-b684-23cd2eaf539c of volume f60ae3fc-0afb-4d50-9f35-75f3c09ba344 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] snapshot_file for this snap is: volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[deac3ce9-bb9a-43be-8e2c-5b50202496a4]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (6925914b-3c96-4488-8fac-9b54e02797f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a6a1ab-34d4-48b7-a92d-a615a44006ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:26 devstack sudo[113825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c Aug 26 19:16:26 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:26 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a6a1ab-34d4-48b7-a92d-a615a44006ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795656322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68ee469-d52f-42e3-9d53-a88845256328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:27Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f662457e-9755-4846-90bc-0cef31afd000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f662457e-9755-4846-90bc-0cef31afd000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee6f7ab-bd99-4fb3-a6f0-0cc331683839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee6f7ab-bd99-4fb3-a6f0-0cc331683839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68ee469-d52f-42e3-9d53-a88845256328', 'volume_name': 'volume-c68ee469-d52f-42e3-9d53-a88845256328', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda78d79-f806-4db0-b87d-1b08832fc406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda78d79-f806-4db0-b87d-1b08832fc406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee4920f-f404-494d-82e4-900c760a9278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:27 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Volume c68ee469-d52f-42e3-9d53-a88845256328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68ee469-d52f-42e3-9d53-a88845256328', 'volume_size': 1} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795656322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68ee469-d52f-42e3-9d53-a88845256328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:27Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Creating volume c68ee469-d52f-42e3-9d53-a88845256328 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:27 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:27 devstack sudo[113827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 1073741824 Aug 26 19:16:27 devstack sudo[113827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:27 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c" returned: 0 in 0.522s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[778c7dd1-426a-41da-a6c2-2cb0f2ff6193]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:27 devstack sudo[113839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 Aug 26 19:16:27 devstack sudo[113839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:27 devstack sudo[113827]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 1073741824" returned: 0 in 0.597s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:27 devstack sudo[113843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 Aug 26 19:16:27 devstack sudo[113843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:27 devstack sudo[113839]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" returned: 0 in 0.571s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:27 devstack sudo[113848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c Aug 26 19:16:27 devstack sudo[113848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:28 devstack sudo[113843]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328" returned: 0 in 0.346s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee4920f-f404-494d-82e4-900c760a9278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68ee469-d52f-42e3-9d53-a88845256328', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e156f39-77fd-44c2-9178-9f01f0b6feac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:28 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Volume volume-c68ee469-d52f-42e3-9d53-a88845256328 (c68ee469-d52f-42e3-9d53-a88845256328): created successfully Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e156f39-77fd-44c2-9178-9f01f0b6feac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (6925914b-3c96-4488-8fac-9b54e02797f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-ebdb3478-b2ce-46cc-b742-73b74fc41f09 tempest-ProjectReaderTests-1699822213 None] Created volume successfully. Aug 26 19:16:28 devstack sudo[113848]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c" returned: 0 in 0.464s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:28 devstack sudo[113857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c Aug 26 19:16:28 devstack sudo[113857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:28 devstack sudo[113857]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344.8fe295aa-f31d-4385-b684-23cd2eaf539c" returned: 0 in 0.347s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-8fe295aa-f31d-4385-b684-23cd2eaf539c" released by "_delete_snapshot" :: held 2.047s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" released by "delete_snapshot" :: held 2.085s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:28 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Created reservations ['08223f89-c056-49ec-9041-cc7251ffc97a', '1f8a23ee-3b4d-4482-bc27-2b4d341b57ab', 'c2df90e0-6750-48cc-ad33-4daef23922d1', '4cdc30c9-7817-404a-92be-0a5fdc2681ff'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Delete snapshot completed successfully. Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-571e8735-7b7e-4b74-bb2e-3f05ab5f6ee7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-8fe295aa-f31d-4385-b684-23cd2eaf539c-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Creating offline snapshot 8cd6e12f-580a-4d89-9e35-5e9896a05915 of volume c68ee469-d52f-42e3-9d53-a88845256328 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f2333-eb29-421d-a01c-502057706a07]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:29 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 Aug 26 19:16:29 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:29 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328" returned: 0 in 0.482s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:29 devstack sudo[113867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 1G Aug 26 19:16:29 devstack sudo[113867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-f60ae3fc-0afb-4d50-9f35-75f3c09ba344-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Lock "cinder-f60ae3fc-0afb-4d50-9f35-75f3c09ba344-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d5efe7-2cf8-4c38-872a-ffe1e80999e2]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:30 devstack sudo[113871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 Aug 26 19:16:30 devstack sudo[113871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:30 devstack sudo[113867]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 1G" returned: 0 in 0.607s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68ee469-d52f-42e3-9d53-a88845256328 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:30 devstack sudo[113875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68ee469-d52f-42e3-9d53-a88845256328 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 Aug 26 19:16:30 devstack sudo[113875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:30 devstack sudo[113871]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" returned: 0 in 0.472s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:30 devstack sudo[113880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344 Aug 26 19:16:30 devstack sudo[113880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:30 devstack sudo[113875]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68ee469-d52f-42e3-9d53-a88845256328 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915" returned: 0 in 0.401s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:30 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 is being set with open permissions: ugo+rw Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:30 devstack sudo[113885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 Aug 26 19:16:30 devstack sudo[113885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:30 devstack sudo[113880]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" returned: 0 in 0.361s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-f60ae3fc-0afb-4d50-9f35-75f3c09ba344" released by "delete_volume" :: held 0.925s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Created reservations ['5421e3cc-6f84-4592-b554-fce541c49974', 'efa43b33-ea5e-4a24-a1ec-4be30525828d', '271127ad-96dd-4b6c-9c63-126e9dbda83a', '130f3b70-7884-46f2-b21f-31492a230d2b'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:31 devstack sudo[113885]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915" returned: 0 in 0.359s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:31 devstack sudo[113889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.info Aug 26 19:16:31 devstack sudo[113889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:31 devstack sudo[113890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:31 devstack sudo[113890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:31 devstack sudo[113890]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.325s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Deleted volume successfully. Aug 26 19:16:31 devstack sudo[113889]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.info" returned: 0 in 0.390s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:31 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.info is being set with open permissions: ugo+rw Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:31 devstack sudo[113895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.info Aug 26 19:16:31 devstack sudo[113895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Flow 'volume_create_manager' (32d17d9a-434c-40a8-848e-ea001d70b2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eed3913-14a6-4796-a041-198410daf0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f25878f9-dbfc-4067-ad80-e982433da84d tempest-ProjectMemberTests-1720022270 None] Lock "cinder-f60ae3fc-0afb-4d50-9f35-75f3c09ba344-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eed3913-14a6-4796-a041-198410daf0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871774909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5034a29e-6e9e-4a80-bfe5-259933478611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2e739c787646318c3a09143a50b981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:32Z,use_quota=True,user_id='5c316194d51e44f78888e7b12d726546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56740a6-ce18-4c13-9984-37d503579638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56740a6-ce18-4c13-9984-37d503579638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a55c467-5c9f-4017-989c-34c5da0ac0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a55c467-5c9f-4017-989c-34c5da0ac0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5034a29e-6e9e-4a80-bfe5-259933478611', 'volume_name': 'volume-5034a29e-6e9e-4a80-bfe5-259933478611', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab274a92-1a7a-48df-a11d-d9e7abf1ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab274a92-1a7a-48df-a11d-d9e7abf1ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e150c3-cb95-405c-bef6-4a7b514b9a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:31 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Volume 5034a29e-6e9e-4a80-bfe5-259933478611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5034a29e-6e9e-4a80-bfe5-259933478611', 'volume_size': 1} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:31 devstack sudo[113895]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.info" returned: 0 in 0.281s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871774909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5034a29e-6e9e-4a80-bfe5-259933478611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2e739c787646318c3a09143a50b981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:32Z,use_quota=True,user_id='5c316194d51e44f78888e7b12d726546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Creating volume 5034a29e-6e9e-4a80-bfe5-259933478611 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:31 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:31 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:31 devstack sudo[113898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611 1073741824 Aug 26 19:16:31 devstack sudo[113898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:31 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-26604cb9-0b5b-4502-91f1-49202e2a87d4 tempest-ProjectReaderTests-1699822213 None] Create snapshot completed successfully Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-8cd6e12f-580a-4d89-9e35-5e9896a05915-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-8cd6e12f-580a-4d89-9e35-5e9896a05915-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-c68ee469-d52f-42e3-9d53-a88845256328" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:32 devstack sudo[113898]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611 1073741824" returned: 0 in 0.673s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-c68ee469-d52f-42e3-9d53-a88845256328" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-8cd6e12f-580a-4d89-9e35-5e9896a05915" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-8cd6e12f-580a-4d89-9e35-5e9896a05915" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Deleting offline snapshot 8cd6e12f-580a-4d89-9e35-5e9896a05915 of volume c68ee469-d52f-42e3-9d53-a88845256328 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] snapshot_file for this snap is: volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c17609a-d2ca-43d8-a32e-5606458d2219]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:32 devstack sudo[113904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611 Aug 26 19:16:32 devstack sudo[113904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:32 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 Aug 26 19:16:32 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (4de819a6-c7ae-4b57-8146-a9db3fbf39a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769d7175-36fe-4745-974e-72983c0de2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:32 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769d7175-36fe-4745-974e-72983c0de2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451544699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e751a109-1c6a-4ea7-8ee8-9ac451db788b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:33Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3fe327-25c9-43fc-88ef-63f9810bcf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3fe327-25c9-43fc-88ef-63f9810bcf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d759423-a265-4ef3-a2aa-b4d2da69db3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d759423-a265-4ef3-a2aa-b4d2da69db3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e751a109-1c6a-4ea7-8ee8-9ac451db788b', 'volume_name': 'volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a36cce2-b662-4539-b257-d6114aeb4918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a36cce2-b662-4539-b257-d6114aeb4918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b59e6-abe8-45b5-b5de-4f850cbf06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Volume e751a109-1c6a-4ea7-8ee8-9ac451db788b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b', 'volume_size': 1} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:33 devstack sudo[113904]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611" returned: 0 in 0.367s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.046s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1451544699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e751a109-1c6a-4ea7-8ee8-9ac451db788b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:33Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Creating volume e751a109-1c6a-4ea7-8ee8-9ac451db788b {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:33 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e150c3-cb95-405c-bef6-4a7b514b9a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5034a29e-6e9e-4a80-bfe5-259933478611', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef8523d-1ca2-43cb-a567-89ec83ba7a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:33 devstack sudo[113908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b 1073741824 Aug 26 19:16:33 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:33 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Volume volume-5034a29e-6e9e-4a80-bfe5-259933478611 (5034a29e-6e9e-4a80-bfe5-259933478611): created successfully Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef8523d-1ca2-43cb-a567-89ec83ba7a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Flow 'volume_create_manager' (32d17d9a-434c-40a8-848e-ea001d70b2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:33 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-14e9cabd-ec6d-497c-ac56-cf9fd22f7806 tempest-ProjectReaderTests-529224321 None] Created volume successfully. Aug 26 19:16:33 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915" returned: 0 in 0.550s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c68ee469-d52f-42e3-9d53-a88845256328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c734fd3c-6fff-4170-9248-42b1d1f24cc8]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:33 devstack sudo[113914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 Aug 26 19:16:33 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:33 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b 1073741824" returned: 0 in 0.598s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:33 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328" returned: 0 in 0.502s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:33 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:33 devstack sudo[113923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b Aug 26 19:16:33 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:33 devstack sudo[113925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 Aug 26 19:16:33 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Acquiring lock "cinder-5034a29e-6e9e-4a80-bfe5-259933478611-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:34 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b" returned: 0 in 0.345s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Lock "cinder-5034a29e-6e9e-4a80-bfe5-259933478611-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b59e6-abe8-45b5-b5de-4f850cbf06b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b077248-510e-4548-94fa-bd199030e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:34 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Volume volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b (e751a109-1c6a-4ea7-8ee8-9ac451db788b): created successfully Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b077248-510e-4548-94fa-bd199030e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (4de819a6-c7ae-4b57-8146-a9db3fbf39a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-85941870-fae3-451b-8a0b-3021d1dfa4ce tempest-ProjectMemberTests-1720022270 None] Created volume successfully. Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Acquiring lock "cinder-quobyte-5034a29e-6e9e-4a80-bfe5-259933478611" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Lock "cinder-quobyte-5034a29e-6e9e-4a80-bfe5-259933478611" acquired by "delete_volume" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36d1aea-efd4-4683-9169-b0d6de7f3f0e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:34 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915" returned: 0 in 0.590s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:34 devstack sudo[113931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611 Aug 26 19:16:34 devstack sudo[113931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:34 devstack sudo[113934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915 Aug 26 19:16:34 devstack sudo[113934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:34 devstack sudo[113934]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328.8cd6e12f-580a-4d89-9e35-5e9896a05915" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:34 devstack sudo[113931]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611" returned: 0 in 0.452s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-8cd6e12f-580a-4d89-9e35-5e9896a05915" released by "_delete_snapshot" :: held 2.110s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-c68ee469-d52f-42e3-9d53-a88845256328" released by "delete_snapshot" :: held 2.158s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:34 devstack sudo[113941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611 Aug 26 19:16:34 devstack sudo[113941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Created reservations ['16988eb9-94c0-4308-9da9-f75f620a8769', 'fc428b54-6681-463f-ab35-636a3dd379f5', '95a5f5e4-0d18-44f4-8c23-ad35a76b7f0c', '582f3bac-aca1-4d80-bad2-a0328e66c3c7'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:34 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Delete snapshot completed successfully. Aug 26 19:16:34 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-258d8225-ff42-415a-b516-d50c60698f30 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-8cd6e12f-580a-4d89-9e35-5e9896a05915-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:35 devstack sudo[113941]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-5034a29e-6e9e-4a80-bfe5-259933478611" returned: 0 in 0.357s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Lock "cinder-quobyte-5034a29e-6e9e-4a80-bfe5-259933478611" released by "delete_volume" :: held 0.879s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Created reservations ['afd207c9-321c-41cf-95cf-415944ab4e6b', 'd7904088-e870-4559-91be-c4002030cbf6', 'e26e0a3c-aed7-49fc-b178-d71908bfc10c', 'b5ab355a-abb9-421a-9d66-bbbb15f552ba'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:35 devstack sudo[113944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:35 devstack sudo[113944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Creating offline snapshot 3f2d2e5c-5ff3-4511-ad31-c62c4c260843 of volume e751a109-1c6a-4ea7-8ee8-9ac451db788b {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ef99d0-b366-4906-ac36-cc09c087bbcf]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:35 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b Aug 26 19:16:35 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:35 devstack sudo[113944]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.435s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:35 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Deleted volume successfully. Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-f5f2762e-9d73-4e9f-9309-6edcf6055457 tempest-ProjectReaderTests-529224321 None] Lock "cinder-5034a29e-6e9e-4a80-bfe5-259933478611-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-c68ee469-d52f-42e3-9d53-a88845256328-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Lock "cinder-c68ee469-d52f-42e3-9d53-a88845256328-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:35 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-c68ee469-d52f-42e3-9d53-a88845256328" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-c68ee469-d52f-42e3-9d53-a88845256328" acquired by "delete_volume" :: waited 0.038s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[174084e7-c581-4d6c-b662-0cd9dbeca37e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:36 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b" returned: 0 in 0.698s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:36 devstack sudo[113954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 1G Aug 26 19:16:36 devstack sudo[113954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:36 devstack sudo[113953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 Aug 26 19:16:36 devstack sudo[113953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Flow 'volume_create_manager' (23d8f0cf-99f8-475d-8aed-4f0cf5e5c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cf8f34-b2db-4772-b7fe-2c90d8f170a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cf8f34-b2db-4772-b7fe-2c90d8f170a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122156225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd97968e-a7b9-4451-a2a4-c1ed1570c10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2e739c787646318c3a09143a50b981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:36Z,use_quota=True,user_id='5c316194d51e44f78888e7b12d726546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a10ec2-d8c6-4efb-9962-6258fd9aa1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a10ec2-d8c6-4efb-9962-6258fd9aa1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77ad1a8-dcc7-46ee-bd4e-1c49b22b4f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77ad1a8-dcc7-46ee-bd4e-1c49b22b4f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd97968e-a7b9-4451-a2a4-c1ed1570c10e', 'volume_name': 'volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479efcbe-a0a0-4eab-9a97-510fef71e2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479efcbe-a0a0-4eab-9a97-510fef71e2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef4660c-f5dd-4064-ac0c-8f5c379dbfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:36 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Volume fd97968e-a7b9-4451-a2a4-c1ed1570c10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e', 'volume_size': 1} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:36 devstack sudo[113953]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328" returned: 0 in 0.452s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:36 devstack sudo[113963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328 Aug 26 19:16:36 devstack sudo[113963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:36 devstack sudo[113954]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 1G" returned: 0 in 0.597s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:36 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 Aug 26 19:16:36 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:36 devstack sudo[113963]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c68ee469-d52f-42e3-9d53-a88845256328" returned: 0 in 0.341s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:36 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-c68ee469-d52f-42e3-9d53-a88845256328" released by "delete_volume" :: held 0.898s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Created reservations ['b5299409-5c7a-445c-b968-6175646614fa', '54b71228-b477-44f1-84ab-e8c542568727', '7e1c2cf8-9f9c-4ec7-b1e1-b673438e5ab4', 'ca680482-9767-4316-8266-d7073249e5d6'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:37 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843" returned: 0 in 0.455s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:37 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 is being set with open permissions: ugo+rw Aug 26 19:16:37 devstack sudo[113973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:37 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:37 devstack sudo[113975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 Aug 26 19:16:37 devstack sudo[113975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:37 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.330s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:37 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Deleted volume successfully. Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-bed76621-388a-47e6-9998-d0d9a9dd967e tempest-ProjectReaderTests-1699822213 None] Lock "cinder-c68ee469-d52f-42e3-9d53-a88845256328-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:37 devstack sudo[113975]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:37 devstack sudo[113980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.info Aug 26 19:16:37 devstack sudo[113980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:37 devstack sudo[113980]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.info" returned: 0 in 0.295s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:37 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.info is being set with open permissions: ugo+rw Aug 26 19:16:37 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:37 devstack sudo[113983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.info Aug 26 19:16:37 devstack sudo[113983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:38 devstack sudo[113983]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.info" returned: 0 in 0.352s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.919s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.881s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122156225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd97968e-a7b9-4451-a2a4-c1ed1570c10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2e739c787646318c3a09143a50b981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:36Z,use_quota=True,user_id='5c316194d51e44f78888e7b12d726546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Creating volume fd97968e-a7b9-4451-a2a4-c1ed1570c10e {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:38 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:38 devstack sudo[113986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e 1073741824 Aug 26 19:16:38 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:38 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-dbdb5d2b-83f8-4d51-ab5b-c52675f88d06 tempest-ProjectMemberTests-1720022270 None] Create snapshot completed successfully Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-3f2d2e5c-5ff3-4511-ad31-c62c4c260843-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-3f2d2e5c-5ff3-4511-ad31-c62c4c260843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-e751a109-1c6a-4ea7-8ee8-9ac451db788b" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-e751a109-1c6a-4ea7-8ee8-9ac451db788b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-3f2d2e5c-5ff3-4511-ad31-c62c4c260843" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-3f2d2e5c-5ff3-4511-ad31-c62c4c260843" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Deleting offline snapshot 3f2d2e5c-5ff3-4511-ad31-c62c4c260843 of volume e751a109-1c6a-4ea7-8ee8-9ac451db788b {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] snapshot_file for this snap is: volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b7f6df-1211-442c-8731-387831d83825]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:38 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:39 devstack sudo[113991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 Aug 26 19:16:39 devstack sudo[113991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (94ae93ec-f8b0-4caa-a05d-44fb14ecf20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b64afe-3aa5-4a82-9faf-2c069e69b04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b64afe-3aa5-4a82-9faf-2c069e69b04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298321982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e420074a-4dea-404c-9f18-58da3bdd0e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:39Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a7835-ef78-4487-92e7-d9a0ea1423bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a7835-ef78-4487-92e7-d9a0ea1423bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a495ef33-673a-4a1d-a533-baeda55ce5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:39 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a495ef33-673a-4a1d-a533-baeda55ce5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e420074a-4dea-404c-9f18-58da3bdd0e69', 'volume_name': 'volume-e420074a-4dea-404c-9f18-58da3bdd0e69', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fb6532-cdc8-45db-b5f4-377dd2b426d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fb6532-cdc8-45db-b5f4-377dd2b426d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b317095-0e82-488b-9443-b681f5b733ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:39 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Volume e420074a-4dea-404c-9f18-58da3bdd0e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e420074a-4dea-404c-9f18-58da3bdd0e69', 'volume_size': 1} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e 1073741824" returned: 0 in 0.842s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:39 devstack sudo[113994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e Aug 26 19:16:39 devstack sudo[113994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:39 devstack sudo[113991]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843" returned: 0 in 0.609s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7422c706-bf3c-4b27-92e9-1d49e734d3a0]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:39 devstack sudo[113994]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e" returned: 0 in 0.419s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298321982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e420074a-4dea-404c-9f18-58da3bdd0e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f623c2b2a556430a8f6e1572e7e850a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:39Z,use_quota=True,user_id='18336549d3c741d4b56d57a23e0e9adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Creating volume e420074a-4dea-404c-9f18-58da3bdd0e69 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:39 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:39 devstack sudo[113999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b Aug 26 19:16:39 devstack sudo[113999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef4660c-f5dd-4064-ac0c-8f5c379dbfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:39 devstack sudo[114001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 1073741824 Aug 26 19:16:39 devstack sudo[114001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9649eb5b-bc00-4df3-9ca3-a3b7b594da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:39 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Volume volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e (fd97968e-a7b9-4451-a2a4-c1ed1570c10e): created successfully Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9649eb5b-bc00-4df3-9ca3-a3b7b594da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:39 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Flow 'volume_create_manager' (23d8f0cf-99f8-475d-8aed-4f0cf5e5c87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:39 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d8adf0ab-7666-4929-8cd8-52abf91d238d tempest-ProjectReaderTests-529224321 None] Created volume successfully. Aug 26 19:16:40 devstack sudo[113999]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b" returned: 0 in 0.592s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:40 devstack sudo[114012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 Aug 26 19:16:40 devstack sudo[114012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:40 devstack sudo[114001]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 1073741824" returned: 0 in 0.616s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:40 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 Aug 26 19:16:40 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:40 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:40 devstack sudo[114012]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843" returned: 0 in 0.625s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69" returned: 0 in 0.413s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:40 devstack sudo[114021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843 Aug 26 19:16:40 devstack sudo[114021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Acquiring lock "cinder-fd97968e-a7b9-4451-a2a4-c1ed1570c10e-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b317095-0e82-488b-9443-b681f5b733ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e420074a-4dea-404c-9f18-58da3bdd0e69', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b485df4c-ef6a-450f-9e83-3474f5affc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Lock "cinder-fd97968e-a7b9-4451-a2a4-c1ed1570c10e-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:40 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Volume volume-e420074a-4dea-404c-9f18-58da3bdd0e69 (e420074a-4dea-404c-9f18-58da3bdd0e69): created successfully Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b485df4c-ef6a-450f-9e83-3474f5affc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:40 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Flow 'volume_create_manager' (94ae93ec-f8b0-4caa-a05d-44fb14ecf20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:40 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-cb97fa82-232b-471e-98fc-f31cb11db2a8 tempest-ProjectReaderTests-1699822213 None] Created volume successfully. Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Acquiring lock "cinder-quobyte-fd97968e-a7b9-4451-a2a4-c1ed1570c10e" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Lock "cinder-quobyte-fd97968e-a7b9-4451-a2a4-c1ed1570c10e" acquired by "delete_volume" :: waited 0.035s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65514a8-eedb-431a-8227-16cc9475fb88]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:41 devstack sudo[114021]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b.3f2d2e5c-5ff3-4511-ad31-c62c4c260843" returned: 0 in 0.464s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-3f2d2e5c-5ff3-4511-ad31-c62c4c260843" released by "_delete_snapshot" :: held 2.470s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-e751a109-1c6a-4ea7-8ee8-9ac451db788b" released by "delete_snapshot" :: held 2.517s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:41 devstack sudo[114058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e Aug 26 19:16:41 devstack sudo[114058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Created reservations ['7c37feda-ef04-43d1-8ecb-e53a2dac9b4c', '7c2234c3-48c3-47ad-8e69-114049b70f5f', '7b18cb1f-e57b-4136-b106-b5d16c15c3cc', '26e4ef32-fc88-40ec-bfae-cd2019bae6fa'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:41 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Delete snapshot completed successfully. Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0711484b-da95-4f99-aef5-54b0eadd9735 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-3f2d2e5c-5ff3-4511-ad31-c62c4c260843-delete_snapshot" released by "delete_snapshot" :: held 2.787s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Creating offline snapshot d6f040d4-64d3-4563-aa40-930787f400ab of volume e420074a-4dea-404c-9f18-58da3bdd0e69 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7fb7b9-583b-4477-95fe-a0e4a2a783ca]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:41 devstack sudo[114058]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e" returned: 0 in 0.555s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:41 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:41 devstack sudo[114066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e Aug 26 19:16:41 devstack sudo[114066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:41 devstack sudo[114065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 Aug 26 19:16:41 devstack sudo[114065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-e751a109-1c6a-4ea7-8ee8-9ac451db788b-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Lock "cinder-e751a109-1c6a-4ea7-8ee8-9ac451db788b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:42 devstack sudo[114065]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69" returned: 0 in 0.525s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:42 devstack sudo[114066]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-fd97968e-a7b9-4451-a2a4-c1ed1570c10e" returned: 0 in 0.508s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:42 devstack sudo[114073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab 1G Aug 26 19:16:42 devstack sudo[114073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-e751a109-1c6a-4ea7-8ee8-9ac451db788b" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Lock "cinder-quobyte-fd97968e-a7b9-4451-a2a4-c1ed1570c10e" released by "delete_volume" :: held 1.175s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-e751a109-1c6a-4ea7-8ee8-9ac451db788b" acquired by "delete_volume" :: waited 0.046s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703f5c8-ca02-4c89-870d-c47db2c10462]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Created reservations ['f6bbe169-2baa-4b2b-aff8-9a150e83833a', 'e5a9daa8-b9d7-4b6e-baa7-a7e7a4817bfc', 'e48f9d00-c071-4fdb-9ec1-4a0ca6d3f0c2', 'c0daa5c5-a31c-4bb3-af38-13220832453c'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:42 devstack sudo[114075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b Aug 26 19:16:42 devstack sudo[114075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:42 devstack sudo[114080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:42 devstack sudo[114080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:42 devstack sudo[114073]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab 1G" returned: 0 in 0.592s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e420074a-4dea-404c-9f18-58da3bdd0e69 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:42 devstack sudo[114084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e420074a-4dea-404c-9f18-58da3bdd0e69 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab Aug 26 19:16:42 devstack sudo[114084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:42 devstack sudo[114080]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.327s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:42 devstack sudo[114075]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:42 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Deleted volume successfully. Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b" returned: 0 in 0.529s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:42 devstack sudo[114089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b Aug 26 19:16:42 devstack sudo[114089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:42 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3da6ec70-f304-49f2-a64e-c0214cf1f9e4 tempest-ProjectReaderTests-529224321 None] Lock "cinder-fd97968e-a7b9-4451-a2a4-c1ed1570c10e-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:43 devstack sudo[114089]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e751a109-1c6a-4ea7-8ee8-9ac451db788b" returned: 0 in 0.342s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:43 devstack sudo[114084]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e420074a-4dea-404c-9f18-58da3bdd0e69 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab" returned: 0 in 0.464s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:43 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab is being set with open permissions: ugo+rw Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-e751a109-1c6a-4ea7-8ee8-9ac451db788b" released by "delete_volume" :: held 0.980s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:43 devstack sudo[114095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab Aug 26 19:16:43 devstack sudo[114095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Created reservations ['0b2e79eb-f823-4d8a-b587-b92b6f1afeb8', '0f1468e4-c79e-491d-99f8-4a604847ce9d', '82258bb7-5e88-4c9a-b1a7-2e7e46ba6ef9', '0a40e640-37a9-432e-b42c-9ecbd2ba2ca9'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:43 devstack sudo[114097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:43 devstack sudo[114097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:43 devstack sudo[114095]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab" returned: 0 in 0.380s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:43 devstack sudo[114100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.info Aug 26 19:16:43 devstack sudo[114100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:43 devstack sudo[114097]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.492s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:43 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Deleted volume successfully. Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:43 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Flow 'volume_create_manager' (bc52e0b6-6530-48fb-a8e2-b5c5571d6e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7efc0a9-46ea-4b72-b4d1-023479e05e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7efc0a9-46ea-4b72-b4d1-023479e05e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1740243450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2e739c787646318c3a09143a50b981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:44Z,use_quota=True,user_id='5c316194d51e44f78888e7b12d726546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184536e2-47a3-48a0-a235-da483b10571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184536e2-47a3-48a0-a235-da483b10571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd09305f-229d-401d-b0a3-bb691ad574b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:44 devstack sudo[114100]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd09305f-229d-401d-b0a3-bb691ad574b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0', 'volume_name': 'volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c337e0db-33f8-4a8b-8581-bdf66349cffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c337e0db-33f8-4a8b-8581-bdf66349cffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c387449-d98d-4b8a-83ea-51d32700b45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:44 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Volume f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0', 'volume_size': 1} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.info" returned: 0 in 0.470s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:44 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.info is being set with open permissions: ugo+rw Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-3a98b42d-c5ca-4b9c-b600-fa0dbfe9f0cf tempest-ProjectMemberTests-1720022270 None] Lock "cinder-e751a109-1c6a-4ea7-8ee8-9ac451db788b-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:44 devstack sudo[114105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.info Aug 26 19:16:44 devstack sudo[114105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:44 devstack sudo[114105]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.info" returned: 0 in 0.277s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1740243450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2e739c787646318c3a09143a50b981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:44Z,use_quota=True,user_id='5c316194d51e44f78888e7b12d726546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Creating volume f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:44 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:44 devstack sudo[114108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 1073741824 Aug 26 19:16:44 devstack sudo[114108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:44 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-03277c31-84a7-47d2-87e4-8e8d9564a64f tempest-ProjectReaderTests-1699822213 None] Create snapshot completed successfully Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-d6f040d4-64d3-4563-aa40-930787f400ab-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-d6f040d4-64d3-4563-aa40-930787f400ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-e420074a-4dea-404c-9f18-58da3bdd0e69" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-e420074a-4dea-404c-9f18-58da3bdd0e69" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-d6f040d4-64d3-4563-aa40-930787f400ab" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-d6f040d4-64d3-4563-aa40-930787f400ab" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Deleting offline snapshot d6f040d4-64d3-4563-aa40-930787f400ab of volume e420074a-4dea-404c-9f18-58da3bdd0e69 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] snapshot_file for this snap is: volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d4b75c-a7bc-4942-b2c5-0801b98f9331]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:44 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (4ae25eaf-faa0-430b-b560-fc27a6855743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3e99a8-14ef-442f-8e82-b3b8b1b747cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:45 devstack sudo[114108]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 1073741824" returned: 0 in 0.706s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:45 devstack sudo[114113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab Aug 26 19:16:45 devstack sudo[114113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3e99a8-14ef-442f-8e82-b3b8b1b747cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2057906426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7d320-8f6f-4c17-b405-607e06e29081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:45Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2910c668-9cfb-4672-9d27-9b104268eb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2910c668-9cfb-4672-9d27-9b104268eb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005b4ede-a86d-4947-bf91-37fceb4ab50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005b4ede-a86d-4947-bf91-37fceb4ab50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b7d320-8f6f-4c17-b405-607e06e29081', 'volume_name': 'volume-53b7d320-8f6f-4c17-b405-607e06e29081', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8386fe-4d58-4e6a-be64-1a20cb9242bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8386fe-4d58-4e6a-be64-1a20cb9242bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25b0b09-a8ce-4447-aa4d-5742b28204cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:45 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Volume 53b7d320-8f6f-4c17-b405-607e06e29081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b7d320-8f6f-4c17-b405-607e06e29081', 'volume_size': 1} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:45 devstack sudo[114116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 Aug 26 19:16:45 devstack sudo[114116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:45 devstack sudo[114113]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab" returned: 0 in 0.547s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e420074a-4dea-404c-9f18-58da3bdd0e69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:45 devstack sudo[114116]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0" returned: 0 in 0.304s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2057906426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7d320-8f6f-4c17-b405-607e06e29081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:45Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Creating volume 53b7d320-8f6f-4c17-b405-607e06e29081 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:45 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c279d59-1d55-43c8-b694-93013e6d4930]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:45 devstack sudo[114123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 1073741824 Aug 26 19:16:45 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c387449-d98d-4b8a-83ea-51d32700b45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c5b57a-f5a4-4ede-a5ea-0a5eb967d366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:45 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Volume volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 (f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0): created successfully Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c5b57a-f5a4-4ede-a5ea-0a5eb967d366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:45 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Flow 'volume_create_manager' (bc52e0b6-6530-48fb-a8e2-b5c5571d6e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:45 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d4b88075-c97b-4c5b-a09b-c0dfab5a2795 tempest-ProjectReaderTests-529224321 None] Created volume successfully. Aug 26 19:16:45 devstack sudo[114124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 Aug 26 19:16:45 devstack sudo[114124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:46 devstack sudo[114124]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69" returned: 0 in 0.515s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:46 devstack sudo[114133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab Aug 26 19:16:46 devstack sudo[114133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Acquiring lock "cinder-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:46 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 1073741824" returned: 0 in 0.666s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Lock "cinder-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:46 devstack sudo[114136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 Aug 26 19:16:46 devstack sudo[114136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Acquiring lock "cinder-quobyte-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Lock "cinder-quobyte-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b73d38-88af-4d29-8081-5e4a23e871db]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:46 devstack sudo[114140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 Aug 26 19:16:46 devstack sudo[114140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:46 devstack sudo[114133]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab" returned: 0 in 0.482s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:46 devstack sudo[114136]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081" returned: 0 in 0.315s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:46 devstack sudo[114145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab Aug 26 19:16:46 devstack sudo[114145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25b0b09-a8ce-4447-aa4d-5742b28204cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b7d320-8f6f-4c17-b405-607e06e29081', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f280f9c2-0c08-45a9-928d-41bc8ba87dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:46 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Volume volume-53b7d320-8f6f-4c17-b405-607e06e29081 (53b7d320-8f6f-4c17-b405-607e06e29081): created successfully Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f280f9c2-0c08-45a9-928d-41bc8ba87dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (4ae25eaf-faa0-430b-b560-fc27a6855743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:46 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-47cb4a5a-1e99-486d-a8fa-731ba2918d7b tempest-ProjectMemberTests-1720022270 None] Created volume successfully. Aug 26 19:16:46 devstack sudo[114140]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0" returned: 0 in 0.427s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:46 devstack sudo[114150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0 Aug 26 19:16:46 devstack sudo[114150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:46 devstack sudo[114145]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:46 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69.d6f040d4-64d3-4563-aa40-930787f400ab" returned: 0 in 0.363s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-d6f040d4-64d3-4563-aa40-930787f400ab" released by "_delete_snapshot" :: held 2.091s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-e420074a-4dea-404c-9f18-58da3bdd0e69" released by "delete_snapshot" :: held 2.132s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Created reservations ['7a51d2de-2793-441c-b641-5638b5e4b71d', '466275dd-c457-42cf-be6a-b9cfe289933f', '679b5f92-f354-48e2-8cf4-ec44ecf831b3', 'd889a9f6-8875-4ab6-b975-1ab29d52c3eb'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:47 devstack sudo[114150]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0" returned: 0 in 0.497s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Lock "cinder-quobyte-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0" released by "delete_volume" :: held 0.996s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:47 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Delete snapshot completed successfully. Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-96653737-f481-4eec-9545-22c38c655913 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-d6f040d4-64d3-4563-aa40-930787f400ab-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Creating offline snapshot 8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 of volume 53b7d320-8f6f-4c17-b405-607e06e29081 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[80356fca-f93e-4551-afc5-bef723174918]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Created reservations ['d32d49a1-a3a3-4d7c-b7ff-85e35fd9a887', '42c4afe7-8e76-4b59-bb3e-1caaa9bec5a9', '1a670aef-5cc5-475d-8dac-d61337931ac3', '7c685813-a4e3-4432-9b0d-08b3a987b8af'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:47 devstack sudo[114154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 Aug 26 19:16:47 devstack sudo[114154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:47 devstack sudo[114157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:47 devstack sudo[114157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:47 devstack sudo[114154]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081" returned: 0 in 0.412s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:47 devstack sudo[114163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 1G Aug 26 19:16:47 devstack sudo[114163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:47 devstack sudo[114157]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:47 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Deleted volume successfully. Aug 26 19:16:47 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-90cde8b1-6594-4c66-97ef-6bc5b03e22a6 tempest-ProjectReaderTests-529224321 None] Lock "cinder-f8dd48e3-4b9b-4877-bcdc-cc2d88fe3cc0-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-e420074a-4dea-404c-9f18-58da3bdd0e69-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-e420074a-4dea-404c-9f18-58da3bdd0e69-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "cinder-quobyte-e420074a-4dea-404c-9f18-58da3bdd0e69" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:48 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-e420074a-4dea-404c-9f18-58da3bdd0e69" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:48 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa241c0d-b6a3-49c1-96ea-36c6974e3936]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:48 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 Aug 26 19:16:48 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:48 devstack sudo[114163]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 1G" returned: 0 in 0.746s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:48 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b7d320-8f6f-4c17-b405-607e06e29081 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:48 devstack sudo[114170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b7d320-8f6f-4c17-b405-607e06e29081 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 Aug 26 19:16:48 devstack sudo[114170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:49 devstack sudo[114168]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69" returned: 0 in 0.703s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:49 devstack sudo[114170]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b7d320-8f6f-4c17-b405-607e06e29081 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539" returned: 0 in 0.392s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:49 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 is being set with open permissions: ugo+rw Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:49 devstack sudo[114184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69 Aug 26 19:16:49 devstack sudo[114184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:49 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 Aug 26 19:16:49 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:49 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539" returned: 0 in 0.316s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:49 devstack sudo[114184]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-e420074a-4dea-404c-9f18-58da3bdd0e69" returned: 0 in 0.425s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:49 devstack sudo[114190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.info Aug 26 19:16:49 devstack sudo[114190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Flow 'volume_create_manager' (ad7f83ca-8d9f-43e3-9f69-3b94a0acad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee7ba13-9ac8-4e09-beb5-b3038cbf3183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-quobyte-e420074a-4dea-404c-9f18-58da3bdd0e69" released by "delete_volume" :: held 1.286s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee7ba13-9ac8-4e09-beb5-b3038cbf3183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392065888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2e739c787646318c3a09143a50b981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:49Z,use_quota=True,user_id='5c316194d51e44f78888e7b12d726546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed6fcc8-490c-4566-8640-9cb5150c6618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed6fcc8-490c-4566-8640-9cb5150c6618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807778bf-4b3a-43ba-8982-9c5275f54fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807778bf-4b3a-43ba-8982-9c5275f54fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851', 'volume_name': 'volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ce990c-0005-4bae-a0fa-1513afab8437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ce990c-0005-4bae-a0fa-1513afab8437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117933e0-e011-47dd-81f8-6a6ad0312957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:49 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Volume 0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851', 'volume_size': 1} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Created reservations ['4d3bdb00-1235-44f4-ada9-81ec70a65801', 'c972a487-44a9-4c55-88ad-4b7ebe459a40', 'd1ac1a8d-b13b-4d81-aade-cc0bbdeddb58', '17f2ecf5-84fa-4b50-b028-bc9bbdb1f3ad'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:49 devstack sudo[114190]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.info" returned: 0 in 0.342s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:49 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.info is being set with open permissions: ugo+rw Aug 26 19:16:49 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:49 devstack sudo[114193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:49 devstack sudo[114193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:49 devstack sudo[114194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.info Aug 26 19:16:49 devstack sudo[114194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:50 devstack sudo[114194]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:50 devstack sudo[114193]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.367s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.info" returned: 0 in 0.343s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.690s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392065888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2e739c787646318c3a09143a50b981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:49Z,use_quota=True,user_id='5c316194d51e44f78888e7b12d726546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Creating volume 0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:50 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:50 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Deleted volume successfully. Aug 26 19:16:50 devstack sudo[114199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 1073741824 Aug 26 19:16:50 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d107a3d0-640f-4680-abc6-bfd3ef5b8f66 tempest-ProjectReaderTests-1699822213 None] Lock "cinder-e420074a-4dea-404c-9f18-58da3bdd0e69-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:50 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-eae4f2e1-e0fd-49f4-8101-b1684ec07306 tempest-ProjectMemberTests-1720022270 None] Create snapshot completed successfully Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-8a0ecf79-b6eb-44ec-80e6-a5f89c30e539-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-8a0ecf79-b6eb-44ec-80e6-a5f89c30e539-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-53b7d320-8f6f-4c17-b405-607e06e29081" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-53b7d320-8f6f-4c17-b405-607e06e29081" acquired by "delete_snapshot" :: waited 0.048s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-8a0ecf79-b6eb-44ec-80e6-a5f89c30e539" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:50 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-8a0ecf79-b6eb-44ec-80e6-a5f89c30e539" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Deleting offline snapshot 8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 of volume 53b7d320-8f6f-4c17-b405-607e06e29081 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] snapshot_file for this snap is: volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 1073741824" returned: 0 in 0.684s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fab0db-5263-4721-b925-dbe0f56da851]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:50 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:50 devstack sudo[114206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 Aug 26 19:16:50 devstack sudo[114206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:51 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 Aug 26 19:16:51 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:51 devstack sudo[114206]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851" returned: 0 in 0.455s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117933e0-e011-47dd-81f8-6a6ad0312957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aefb989-9e7a-466a-a73f-52ff4d56c8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:51 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Volume volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 (0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851): created successfully Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aefb989-9e7a-466a-a73f-52ff4d56c8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Flow 'volume_create_manager' (ad7f83ca-8d9f-43e3-9f69-3b94a0acad04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:51 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539" returned: 0 in 0.619s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53b7d320-8f6f-4c17-b405-607e06e29081(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:16:51 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-52726172-d54b-409b-aaf9-2cd7eeac5db0 tempest-ProjectReaderTests-529224321 None] Created volume successfully. Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b982515-6b5f-40b4-95be-a5a90f1f772f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:51 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:51 devstack sudo[114213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 Aug 26 19:16:51 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:51 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081" returned: 0 in 0.453s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:52 devstack sudo[114218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 Aug 26 19:16:52 devstack sudo[114218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:52 devstack sudo[114218]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539" returned: 0 in 0.434s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:52 devstack sudo[114224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539 Aug 26 19:16:52 devstack sudo[114224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Acquiring lock "cinder-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Lock "cinder-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Acquiring lock "cinder-quobyte-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Lock "cinder-quobyte-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad844b85-4559-4367-bb1c-6237b2a524bd]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:52 devstack sudo[114224]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081.8a0ecf79-b6eb-44ec-80e6-a5f89c30e539" returned: 0 in 0.452s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-8a0ecf79-b6eb-44ec-80e6-a5f89c30e539" released by "_delete_snapshot" :: held 2.106s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:52 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-53b7d320-8f6f-4c17-b405-607e06e29081" released by "delete_snapshot" :: held 2.156s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:52 devstack sudo[114227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 Aug 26 19:16:52 devstack sudo[114227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Created reservations ['76c338b3-6410-40e0-a184-fe19001aa670', 'cdc5c1c2-1ce0-47ab-8eef-e9244a765511', 'f5172ef3-14d0-4e5c-a718-51065f484f0c', 'd6423d30-18fc-4d4d-aca2-d65d9bff88aa'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:53 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Delete snapshot completed successfully. Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-c26e3351-b7d1-4b04-99d9-dbecba1e83f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-8a0ecf79-b6eb-44ec-80e6-a5f89c30e539-delete_snapshot" released by "delete_snapshot" :: held 2.512s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:53 devstack sudo[114227]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851" returned: 0 in 0.563s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:53 devstack sudo[114233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851 Aug 26 19:16:53 devstack sudo[114233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:53 devstack sudo[114233]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851" returned: 0 in 0.318s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Lock "cinder-quobyte-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851" released by "delete_volume" :: held 0.950s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Created reservations ['8117f54a-be31-4162-bd94-8fa137f7c774', '213691db-c87c-4a49-a597-8a3a3dfaeed1', 'fbc9677b-402a-4c79-92e7-532a244079ae', 'cccf66c9-b22c-49e0-87d8-62f4b1291926'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:53 devstack sudo[114236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:53 devstack sudo[114236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:53 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-53b7d320-8f6f-4c17-b405-607e06e29081-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-53b7d320-8f6f-4c17-b405-607e06e29081-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-53b7d320-8f6f-4c17-b405-607e06e29081" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-53b7d320-8f6f-4c17-b405-607e06e29081" acquired by "delete_volume" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b96448-1fad-4b6d-b481-bca8b1539f37]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:54 devstack sudo[114236]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.482s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:54 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Deleted volume successfully. Aug 26 19:16:54 devstack sudo[114238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 Aug 26 19:16:54 devstack sudo[114238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-a5066aae-896a-4b73-8437-937ce2814a5a tempest-ProjectReaderTests-529224321 None] Lock "cinder-0fb2eb3b-6e7b-4f16-9fdb-81545a4e4851-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:54 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:54 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:54 devstack sudo[114238]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081" returned: 0 in 0.676s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:54 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.427s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:54 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081 Aug 26 19:16:54 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG oslo_service.periodic_task [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] Running periodic task VolumeManager._thread_info {{(pid=93671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread count: 28 {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 19:16:54 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-92d9d79f-5d32-49f8-9649-1f95536967d6 None None] thread info: [<_MainThread(MainThread, started 138948978569344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 19:16:55 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-53b7d320-8f6f-4c17-b405-607e06e29081" returned: 0 in 0.363s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-53b7d320-8f6f-4c17-b405-607e06e29081" released by "delete_volume" :: held 1.147s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Created reservations ['d576ab49-131d-4cb3-a264-c91b13a39636', '5baf0128-893e-4f31-9675-852a25c47f6a', 'f17d4108-f98e-4ce9-81dd-97cc26ad4daa', '85691896-ba8b-4ca1-88b3-ba9bb508d9ad'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:55 devstack sudo[114253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:16:55 devstack sudo[114253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:55 devstack sudo[114253]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.284s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:16:55 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Deleted volume successfully. Aug 26 19:16:55 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-b2fe0791-ab05-449d-ab8f-a9a34f2f6a20 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-53b7d320-8f6f-4c17-b405-607e06e29081-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Flow 'volume_create_manager' (4a134b6d-0c7d-4f82-93b8-c845069ab628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1801839f-daa9-45f9-a4a8-7a2cd0bcaf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1801839f-daa9-45f9-a4a8-7a2cd0bcaf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-292686100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c690a165-a86d-44a4-ad94-085d03537c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fabc127e502453f9e070e066d39c3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:57Z,use_quota=True,user_id='89e4ccb6aea54d2baeb0a1746f13ec67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd64858-459a-4804-97b0-ffb425dfab34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd64858-459a-4804-97b0-ffb425dfab34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a1d356-885e-479e-b200-37a51c83fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a1d356-885e-479e-b200-37a51c83fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c690a165-a86d-44a4-ad94-085d03537c9e', 'volume_name': 'volume-c690a165-a86d-44a4-ad94-085d03537c9e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba8efc0-bacd-4398-bdb3-130edcb59f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba8efc0-bacd-4398-bdb3-130edcb59f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a46bf92-32e1-41e5-8921-049d1942e3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:56 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Volume c690a165-a86d-44a4-ad94-085d03537c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c690a165-a86d-44a4-ad94-085d03537c9e', 'volume_size': 1} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-292686100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c690a165-a86d-44a4-ad94-085d03537c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fabc127e502453f9e070e066d39c3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:57Z,use_quota=True,user_id='89e4ccb6aea54d2baeb0a1746f13ec67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:56 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Creating volume c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:57 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:57 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e 1073741824 Aug 26 19:16:57 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (95325595-e9fc-4ddc-aa23-1b228a389499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c3fd3e-dce2-4da8-808a-ae0d51c59283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c3fd3e-dce2-4da8-808a-ae0d51c59283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546992211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265290db-756f-4c3f-853d-db968c772e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:57Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408cd917-005f-4a59-862a-0ecf78ccb8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408cd917-005f-4a59-862a-0ecf78ccb8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db589d-73a3-4624-802a-5af4c8be7013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db589d-73a3-4624-802a-5af4c8be7013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265290db-756f-4c3f-853d-db968c772e94', 'volume_name': 'volume-265290db-756f-4c3f-853d-db968c772e94', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd99f4df-fc2b-4b3e-98c0-6ecf5bf0c6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd99f4df-fc2b-4b3e-98c0-6ecf5bf0c6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e236d643-c410-4a69-9f87-92ee102ff803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:57 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Volume 265290db-756f-4c3f-853d-db968c772e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265290db-756f-4c3f-853d-db968c772e94', 'volume_size': 1} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:57 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e 1073741824" returned: 0 in 0.660s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:57 devstack sudo[114263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e Aug 26 19:16:57 devstack sudo[114263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:57 devstack sudo[114263]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e" returned: 0 in 0.283s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546992211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265290db-756f-4c3f-853d-db968c772e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:16:57Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:16:57 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Creating volume 265290db-756f-4c3f-853d-db968c772e94 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:16:58 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a46bf92-32e1-41e5-8921-049d1942e3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c690a165-a86d-44a4-ad94-085d03537c9e', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3779b6d-eb4e-4d05-9940-d01028a3a534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:58 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 1073741824 Aug 26 19:16:58 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:58 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Volume volume-c690a165-a86d-44a4-ad94-085d03537c9e (c690a165-a86d-44a4-ad94-085d03537c9e): created successfully Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3779b6d-eb4e-4d05-9940-d01028a3a534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Flow 'volume_create_manager' (4a134b6d-0c7d-4f82-93b8-c845069ab628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-4b335ec4-1717-434a-a666-be1539f6adfa tempest-SnapshotDependencyTests-2000186266 None] Created volume successfully. Aug 26 19:16:58 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 1073741824" returned: 0 in 0.440s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:58 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 Aug 26 19:16:58 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:58 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94" returned: 0 in 0.242s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e236d643-c410-4a69-9f87-92ee102ff803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265290db-756f-4c3f-853d-db968c772e94', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d5599f-fac8-4fc8-b598-6e07f24abd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:16:58 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Volume volume-265290db-756f-4c3f-853d-db968c772e94 (265290db-756f-4c3f-853d-db968c772e94): created successfully Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d5599f-fac8-4fc8-b598-6e07f24abd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:16:58 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (95325595-e9fc-4ddc-aa23-1b228a389499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:16:58 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-e52a6812-7e60-4ad5-9644-53380b9c03ef tempest-ProjectMemberTests-1720022270 None] Created volume successfully. Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Creating offline snapshot bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c of volume c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47902ce-020f-4d30-aa56-3febbf8d5649]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:59 devstack sudo[114275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e Aug 26 19:16:59 devstack sudo[114275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:59 devstack sudo[114275]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e" returned: 0 in 0.420s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:16:59 devstack sudo[114280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c 1G Aug 26 19:16:59 devstack sudo[114280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:16:59 devstack sudo[114280]: pam_unix(sudo:session): session closed for user root Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c 1G" returned: 0 in 0.490s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:16:59 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c690a165-a86d-44a4-ad94-085d03537c9e -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:00 devstack sudo[114286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c690a165-a86d-44a4-ad94-085d03537c9e -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c Aug 26 19:17:00 devstack sudo[114286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:00 devstack sudo[114286]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c690a165-a86d-44a4-ad94-085d03537c9e -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c" returned: 0 in 0.381s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:00 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c is being set with open permissions: ugo+rw Aug 26 19:17:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:00 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c Aug 26 19:17:00 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:00 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c" returned: 0 in 0.258s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:00 devstack sudo[114294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.info Aug 26 19:17:00 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:00 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.info" returned: 0 in 0.263s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:00 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.info is being set with open permissions: ugo+rw Aug 26 19:17:00 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:00 devstack sudo[114297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.info Aug 26 19:17:00 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:01 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.info" returned: 0 in 0.300s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.211s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.620s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:01 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Creating offline snapshot 93e9e47a-7162-46d9-96fc-1167e722afed of volume 265290db-756f-4c3f-853d-db968c772e94 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:17:01 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-cd66e5d7-ae78-48a3-b806-54254fb94286 tempest-SnapshotDependencyTests-2000186266 None] Create snapshot completed successfully Aug 26 19:17:01 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6002de9-5486-430b-aea0-742577500451]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:01 devstack sudo[114300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 Aug 26 19:17:01 devstack sudo[114300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:01 devstack sudo[114300]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94" returned: 0 in 0.420s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:01 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:01 devstack sudo[114308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed 1G Aug 26 19:17:01 devstack sudo[114308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:02 devstack sudo[114308]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed 1G" returned: 0 in 0.484s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265290db-756f-4c3f-853d-db968c772e94 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:02 devstack sudo[114314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265290db-756f-4c3f-853d-db968c772e94 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed Aug 26 19:17:02 devstack sudo[114314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:02 devstack sudo[114314]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265290db-756f-4c3f-853d-db968c772e94 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed" returned: 0 in 0.311s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:02 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed is being set with open permissions: ugo+rw Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:02 devstack sudo[114320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed Aug 26 19:17:02 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:02 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed" returned: 0 in 0.284s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Flow 'volume_create_manager' (f9a5c79f-12c8-41d9-8b54-6aa81e542ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ab4d1c-cd53-4edb-ac11-5c1775b85318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ab4d1c-cd53-4edb-ac11-5c1775b85318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90666860-3f9a-490c-801b-f72e4d390d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fabc127e502453f9e070e066d39c3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:17:03Z,use_quota=True,user_id='89e4ccb6aea54d2baeb0a1746f13ec67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:02 devstack sudo[114323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.info Aug 26 19:17:02 devstack sudo[114323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6bceaa-e7ac-411b-83e5-6026ec9e82db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6bceaa-e7ac-411b-83e5-6026ec9e82db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43467ed2-5837-489c-a011-28c2ad27771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43467ed2-5837-489c-a011-28c2ad27771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90666860-3f9a-490c-801b-f72e4d390d0d', 'volume_name': 'volume-90666860-3f9a-490c-801b-f72e4d390d0d', 'volume_size': 1, 'snapshot_id': 'bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2cf84e-79ab-4396-9274-40ed84a6827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2cf84e-79ab-4396-9274-40ed84a6827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5917431e-f22f-4333-918d-c20984a28be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:02 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Volume 90666860-3f9a-490c-801b-f72e4d390d0d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90666860-3f9a-490c-801b-f72e4d390d0d', 'volume_size': 1, 'snapshot_id': 'bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c'} Aug 26 19:17:02 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:03 devstack sudo[114323]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.info" returned: 0 in 0.269s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:03 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.info is being set with open permissions: ugo+rw Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:03 devstack sudo[114326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.info Aug 26 19:17:03 devstack sudo[114326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:03 devstack sudo[114326]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.info" returned: 0 in 0.261s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.487s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "cinder-quobyte-bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c-90666860-3f9a-490c-801b-f72e4d390d0d" by "_create_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c-90666860-3f9a-490c-801b-f72e4d390d0d" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Creating volume 90666860-3f9a-490c-801b-f72e4d390d0d from snapshot bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c {{(pid=93671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "cinder-quobyte-90666860-3f9a-490c-801b-f72e4d390d0d" by "_copy_volume_from_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:03 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-db279358-4d79-4850-8a7a-e9bd77c75e3b tempest-ProjectMemberTests-1720022270 None] Create snapshot completed successfully Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-90666860-3f9a-490c-801b-f72e4d390d0d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] snapshot: bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c, volume: 90666860-3f9a-490c-801b-f72e4d390d0d, {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d493c5a9-69e7-4d81-bb26-1001182dc9a6]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:03 devstack sudo[114329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c Aug 26 19:17:03 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-93e9e47a-7162-46d9-96fc-1167e722afed-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-93e9e47a-7162-46d9-96fc-1167e722afed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-265290db-756f-4c3f-853d-db968c772e94" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-265290db-756f-4c3f-853d-db968c772e94" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-93e9e47a-7162-46d9-96fc-1167e722afed" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-93e9e47a-7162-46d9-96fc-1167e722afed" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Deleting offline snapshot 93e9e47a-7162-46d9-96fc-1167e722afed of volume 265290db-756f-4c3f-853d-db968c772e94 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] snapshot_file for this snap is: volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[823d473b-dce5-4b05-9824-ebeb8f7ab759]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:03 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:04 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c" returned: 0 in 0.497s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c690a165-a86d-44a4-ad94-085d03537c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2477e8c-69a4-4069-9c13-8759dd63c0e9]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:04 devstack sudo[114333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed Aug 26 19:17:04 devstack sudo[114333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:04 devstack sudo[114336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e Aug 26 19:17:04 devstack sudo[114336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:04 devstack sudo[114333]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed" returned: 0 in 0.415s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-265290db-756f-4c3f-853d-db968c772e94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c838e483-75d5-4baf-af75-7df6b0193955]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:04 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 Aug 26 19:17:04 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:04 devstack sudo[114336]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e" returned: 0 in 0.489s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Creating direct copy from snapshot {{(pid=93671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG cinder.utils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Path /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d not found in is_blk_device check {{(pid=93671) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:04 devstack sudo[114347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d Aug 26 19:17:04 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:04 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94" returned: 0 in 0.454s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:04 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:04 devstack sudo[114354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed Aug 26 19:17:04 devstack sudo[114354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:05 devstack sudo[114354]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed" returned: 0 in 0.675s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:05 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:05 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed Aug 26 19:17:05 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:06 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:06 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94.93e9e47a-7162-46d9-96fc-1167e722afed" returned: 0 in 1.061s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-93e9e47a-7162-46d9-96fc-1167e722afed" released by "_delete_snapshot" :: held 2.737s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:06 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-265290db-756f-4c3f-853d-db968c772e94" released by "delete_snapshot" :: held 2.777s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:06 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:DELETE=22,cinder:SELECT=175,cinder:INSERT=63,cinder:UPDATE=238 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:17:06 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=185,cinder:UPDATE=225,cinder:DELETE=18,cinder:INSERT=61 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:17:06 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Created reservations ['4ea5da26-56d3-462c-a634-765f4ccc9662', 'c0ebcfde-1058-4bcb-bc9f-57fc1fe837c2', 'dedf0cc9-b164-4b94-b51a-c87926979e58', 'bdc8da30-dcb5-4906-9873-f2508f7b6f70'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:07 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Delete snapshot completed successfully. Aug 26 19:17:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9ff4842f-b95f-419d-954f-5d2acbee4216 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-93e9e47a-7162-46d9-96fc-1167e722afed-delete_snapshot" released by "delete_snapshot" :: held 3.188s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-265290db-756f-4c3f-853d-db968c772e94-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Lock "cinder-265290db-756f-4c3f-853d-db968c772e94-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-265290db-756f-4c3f-853d-db968c772e94" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:07 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-265290db-756f-4c3f-853d-db968c772e94" acquired by "delete_volume" :: waited 0.078s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:07 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[53511881-6adb-453f-b9bb-df8d83f26cbb]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:07 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:08 devstack sudo[114373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 Aug 26 19:17:08 devstack sudo[114373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:09 devstack sudo[114373]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94" returned: 0 in 1.357s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:09 devstack sudo[114378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94 Aug 26 19:17:09 devstack sudo[114378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:09 devstack sudo[114378]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:09 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-265290db-756f-4c3f-853d-db968c772e94" returned: 0 in 0.794s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:09 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-265290db-756f-4c3f-853d-db968c772e94" released by "delete_volume" :: held 2.367s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Created reservations ['6a43a476-c088-4904-82e1-9102e0f6d82a', '1090e772-4cb7-4fad-810c-613c0cc31025', '7a0d4faf-5436-4823-ac7c-bb1e5df6de88', '8de50ea7-684c-432c-9ab8-989129c3cd69'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:10 devstack sudo[114381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:17:10 devstack sudo[114381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:10 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d" returned: 0 in 6.014s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG cinder.image.image_utils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Image conversion details: src /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d {{(pid=93671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 19:17:10 devstack cinder-volume[93671]: INFO cinder.image.image_utils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Converted 1024.00 MB image at 170.21 MB/s Aug 26 19:17:10 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d is being set with open permissions: ugo+rw Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:10 devstack sudo[114383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d Aug 26 19:17:10 devstack sudo[114383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:10 devstack sudo[114381]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.396s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:17:10 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Deleted volume successfully. Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-8aa167d8-7991-4419-852d-b6b0cb045fba tempest-ProjectMemberTests-1720022270 None] Lock "cinder-265290db-756f-4c3f-853d-db968c772e94-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:10 devstack sudo[114383]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d" returned: 0 in 0.305s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-90666860-3f9a-490c-801b-f72e4d390d0d" released by "_copy_volume_from_snapshot" :: held 7.419s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c-90666860-3f9a-490c-801b-f72e4d390d0d" released by "_create_volume_from_snapshot" :: held 7.502s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:10 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.532s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5917431e-f22f-4333-918d-c20984a28be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90666860-3f9a-490c-801b-f72e4d390d0d', 'volume_size': 1, 'snapshot_id': 'bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c'}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d652b401-5b1c-4615-9081-0073ce8a3897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Volume volume-90666860-3f9a-490c-801b-f72e4d390d0d (90666860-3f9a-490c-801b-f72e4d390d0d): created successfully Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d652b401-5b1c-4615-9081-0073ce8a3897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Flow 'volume_create_manager' (f9a5c79f-12c8-41d9-8b54-6aa81e542ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:11 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-cab144b4-6f53-4776-9e95-d072e0981f0a tempest-SnapshotDependencyTests-2000186266 None] Created volume successfully. Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Flow 'volume_create_manager' (883b285a-da97-4970-818d-f6b66b71f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649f67ee-4731-43d7-beed-2982db2e34af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649f67ee-4731-43d7-beed-2982db2e34af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303573004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60da31e-9ccc-4b14-a6b8-93fedaebb74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdb22ee73504fd7b27abfc9e73304f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:17:11Z,use_quota=True,user_id='34a10bbf18d24ef2900eaa642f8573a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955ec6ef-340d-48d6-82f9-25543fb1e8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955ec6ef-340d-48d6-82f9-25543fb1e8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ef532a-525c-4537-bf53-504c0d5877c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ef532a-525c-4537-bf53-504c0d5877c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60da31e-9ccc-4b14-a6b8-93fedaebb74f', 'volume_name': 'volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f9bfc6-d0eb-426c-94de-dc3c3050d805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f9bfc6-d0eb-426c-94de-dc3c3050d805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131d9dda-bc35-4ec5-bcb4-b1e94e324c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Volume d60da31e-9ccc-4b14-a6b8-93fedaebb74f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f', 'volume_size': 1} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303573004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60da31e-9ccc-4b14-a6b8-93fedaebb74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdb22ee73504fd7b27abfc9e73304f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:17:11Z,use_quota=True,user_id='34a10bbf18d24ef2900eaa642f8573a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Creating volume d60da31e-9ccc-4b14-a6b8-93fedaebb74f {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:17:11 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:11 devstack sudo[114387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f 1073741824 Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:17:11 devstack sudo[114387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (184eb197-6445-4773-9ea8-e24fa3cabc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf26199c-818c-450c-aae9-e3973464dab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf26199c-818c-450c-aae9-e3973464dab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029628911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02086690-acf2-4615-9900-3e06712fa432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:17:12Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764d5f63-f6f9-4a72-bbcd-2ca05d4e10d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764d5f63-f6f9-4a72-bbcd-2ca05d4e10d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db15f90a-f932-4b9b-a2ef-4a2e60458457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db15f90a-f932-4b9b-a2ef-4a2e60458457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02086690-acf2-4615-9900-3e06712fa432', 'volume_name': 'volume-02086690-acf2-4615-9900-3e06712fa432', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0d5c7e-0598-478c-aa4e-b1ccaf73ea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0d5c7e-0598-478c-aa4e-b1ccaf73ea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20108a31-7f13-4996-a13a-898afe5132a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:11 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Volume 02086690-acf2-4615-9900-3e06712fa432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02086690-acf2-4615-9900-3e06712fa432', 'volume_size': 1} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "cinder-bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "cinder-quobyte-c690a165-a86d-44a4-ad94-085d03537c9e" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-c690a165-a86d-44a4-ad94-085d03537c9e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "cinder-quobyte-bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Deleting offline snapshot bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c of volume c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:17:11 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] snapshot_file for this snap is: volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bb1863-4338-4693-a141-1a8557624e94]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:12 devstack sudo[114392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c Aug 26 19:17:12 devstack sudo[114392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:12 devstack sudo[114387]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f 1073741824" returned: 0 in 0.482s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:12 devstack sudo[114395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f Aug 26 19:17:12 devstack sudo[114395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:12 devstack sudo[114392]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c" returned: 0 in 0.423s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c690a165-a86d-44a4-ad94-085d03537c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[444dd753-f749-4ff1-a059-fd0cb3635091]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:12 devstack sudo[114395]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f" returned: 0 in 0.273s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029628911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02086690-acf2-4615-9900-3e06712fa432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:17:12Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Creating volume 02086690-acf2-4615-9900-3e06712fa432 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:17:12 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131d9dda-bc35-4ec5-bcb4-b1e94e324c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:12 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 1073741824 Aug 26 19:17:12 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7ad84f-43d1-42bf-9720-459f7ee911a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:12 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Volume volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f (d60da31e-9ccc-4b14-a6b8-93fedaebb74f): created successfully Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7ad84f-43d1-42bf-9720-459f7ee911a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Flow 'volume_create_manager' (883b285a-da97-4970-818d-f6b66b71f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:12 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e Aug 26 19:17:12 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:12 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-2749d8af-1015-42ba-8a32-e9d0eb48979b tempest-ProjectReaderTests-1945611304 None] Created volume successfully. Aug 26 19:17:12 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:12 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 1073741824" returned: 0 in 0.470s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:13 devstack sudo[114411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 Aug 26 19:17:13 devstack sudo[114411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:13 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e" returned: 0 in 0.589s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:13 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c Aug 26 19:17:13 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:13 devstack sudo[114411]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432" returned: 0 in 0.273s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20108a31-7f13-4996-a13a-898afe5132a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02086690-acf2-4615-9900-3e06712fa432', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eea5b6c-0638-4461-91e0-9db42cd91930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:13 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Volume volume-02086690-acf2-4615-9900-3e06712fa432 (02086690-acf2-4615-9900-3e06712fa432): created successfully Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eea5b6c-0638-4461-91e0-9db42cd91930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (184eb197-6445-4773-9ea8-e24fa3cabc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:13 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-82a4528f-1da7-4d24-abbc-666919856d7c tempest-ProjectMemberTests-1720022270 None] Created volume successfully. Aug 26 19:17:13 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c" returned: 0 in 0.399s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:13 devstack sudo[114419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c Aug 26 19:17:13 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Acquiring lock "cinder-d60da31e-9ccc-4b14-a6b8-93fedaebb74f-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Lock "cinder-d60da31e-9ccc-4b14-a6b8-93fedaebb74f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:13 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e.bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c" returned: 0 in 0.306s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Acquiring lock "cinder-quobyte-d60da31e-9ccc-4b14-a6b8-93fedaebb74f" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Lock "cinder-quobyte-d60da31e-9ccc-4b14-a6b8-93fedaebb74f" acquired by "delete_volume" :: waited 0.055s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d44ff-21ef-44ff-8a7e-ef8f757a1316]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c" released by "_delete_snapshot" :: held 1.927s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-c690a165-a86d-44a4-ad94-085d03537c9e" released by "delete_snapshot" :: held 1.960s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Creating offline snapshot 77cee23d-a5f8-4184-a063-d78df7b2f0e0 of volume 02086690-acf2-4615-9900-3e06712fa432 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84ec857-ffb1-4227-9f47-b6ad12b00d20]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:13 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:14 devstack sudo[114422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f Aug 26 19:17:14 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Created reservations ['5f68d81c-71de-445c-a755-f62667f5dc43', '2fba1ba0-2e6d-4354-bbd4-ca858c91e859', '5a1851d7-7520-41c4-adc5-e57e32566f5c', '67027b7d-d5ea-4b11-803c-8bbed629971f'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:14 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Delete snapshot completed successfully. Aug 26 19:17:14 devstack sudo[114423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 Aug 26 19:17:14 devstack sudo[114423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-49865664-6bbc-4430-99ec-719e8a537b7d tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-bbab9cb1-4a7a-4144-9bde-cf8c14b77f3c-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:14 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f" returned: 0 in 0.418s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:14 devstack sudo[114431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f Aug 26 19:17:14 devstack sudo[114431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:14 devstack sudo[114423]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432" returned: 0 in 0.413s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:14 devstack sudo[114434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 1G Aug 26 19:17:14 devstack sudo[114434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:14 devstack sudo[114431]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-d60da31e-9ccc-4b14-a6b8-93fedaebb74f" returned: 0 in 0.271s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Lock "cinder-quobyte-d60da31e-9ccc-4b14-a6b8-93fedaebb74f" released by "delete_volume" :: held 0.734s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Created reservations ['4279f2c2-e7a8-442c-8143-c6f49bb344f7', '97af3548-0e48-4891-b64b-d28d556c7b6a', '55e31d5c-2128-4a6c-8e61-3d2dd7cece0f', '97611724-263e-4f87-b77f-74cc849b4fa6'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:14 devstack sudo[114440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:17:14 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:14 devstack sudo[114434]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 1G" returned: 0 in 0.428s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02086690-acf2-4615-9900-3e06712fa432 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:14 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02086690-acf2-4615-9900-3e06712fa432 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 Aug 26 19:17:14 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:14 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.281s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:14 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:17:15 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Deleted volume successfully. Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-9082a036-cc3b-438d-969c-7aab4ae38d18 tempest-ProjectReaderTests-1945611304 None] Lock "cinder-d60da31e-9ccc-4b14-a6b8-93fedaebb74f-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:15 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02086690-acf2-4615-9900-3e06712fa432 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0" returned: 0 in 0.376s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:15 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 is being set with open permissions: ugo+rw Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "cinder-c690a165-a86d-44a4-ad94-085d03537c9e-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:15 devstack sudo[114449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 Aug 26 19:17:15 devstack sudo[114449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-c690a165-a86d-44a4-ad94-085d03537c9e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "cinder-quobyte-c690a165-a86d-44a4-ad94-085d03537c9e" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-c690a165-a86d-44a4-ad94-085d03537c9e" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[975fb62c-6630-4830-ae32-11e0e3c85e88]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:15 devstack sudo[114451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e Aug 26 19:17:15 devstack sudo[114451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:15 devstack sudo[114449]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0" returned: 0 in 0.348s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:15 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.info Aug 26 19:17:15 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Flow 'volume_create_manager' (59062f98-167a-4be1-b28e-9fec39eca1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd042b62-a39d-4ac5-9ef1-e1098fb2c1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd042b62-a39d-4ac5-9ef1-e1098fb2c1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272551236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7621ed2f-11aa-4fef-9cf9-efb361dfbff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdb22ee73504fd7b27abfc9e73304f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:17:16Z,use_quota=True,user_id='34a10bbf18d24ef2900eaa642f8573a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7686c40a-9e68-4c1f-958a-b90c4ec7619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7686c40a-9e68-4c1f-958a-b90c4ec7619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccbf770-4efd-4d84-a441-47dab9b72b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccbf770-4efd-4d84-a441-47dab9b72b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7621ed2f-11aa-4fef-9cf9-efb361dfbff1', 'volume_name': 'volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6214347c-3cb6-4390-a12b-65d2390a3e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6214347c-3cb6-4390-a12b-65d2390a3e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad235c04-d741-4c99-8d87-2d04d23a4ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:15 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Volume 7621ed2f-11aa-4fef-9cf9-efb361dfbff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1', 'volume_size': 1} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:15 devstack sudo[114451]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e" returned: 0 in 0.402s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:15 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e Aug 26 19:17:15 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:15 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.info" returned: 0 in 0.282s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:15 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.info is being set with open permissions: ugo+rw Aug 26 19:17:15 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:15 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.info Aug 26 19:17:15 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:16 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-c690a165-a86d-44a4-ad94-085d03537c9e" returned: 0 in 0.278s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-c690a165-a86d-44a4-ad94-085d03537c9e" released by "delete_volume" :: held 0.759s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:16 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.info" returned: 0 in 0.261s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272551236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7621ed2f-11aa-4fef-9cf9-efb361dfbff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cdb22ee73504fd7b27abfc9e73304f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:17:16Z,use_quota=True,user_id='34a10bbf18d24ef2900eaa642f8573a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Creating volume 7621ed2f-11aa-4fef-9cf9-efb361dfbff1 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:17:16 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:16 devstack sudo[114466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 1073741824 Aug 26 19:17:16 devstack sudo[114466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:16 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-a06d7835-e470-4618-ad3b-7e16f3dcbeda tempest-ProjectMemberTests-1720022270 None] Create snapshot completed successfully Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Created reservations ['18f6c21b-3b58-4c0c-a578-33a3d0cda7a9', '950267a3-31da-4d5e-9614-c6c59f6ee8a8', '8a2d2731-3164-4754-a6b0-6c4cf5d4d646', '320dd619-8971-4cca-8aa3-c2bd6e5be4dc'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:16 devstack sudo[114468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:17:16 devstack sudo[114468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "cinder-90666860-3f9a-490c-801b-f72e4d390d0d-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-90666860-3f9a-490c-801b-f72e4d390d0d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "cinder-quobyte-90666860-3f9a-490c-801b-f72e4d390d0d" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-90666860-3f9a-490c-801b-f72e4d390d0d" acquired by "delete_volume" :: waited 0.024s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[72294e5f-a1e3-4ff7-8dc5-25597d948e8c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:16 devstack sudo[114468]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.329s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:17:16 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Deleted volume successfully. Aug 26 19:17:16 devstack sudo[114466]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 1073741824" returned: 0 in 0.518s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:16 devstack sudo[114474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d Aug 26 19:17:16 devstack sudo[114474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-42aa688d-1e60-4bd1-9c41-9cc9922fe128 tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-c690a165-a86d-44a4-ad94-085d03537c9e-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:16 devstack sudo[114477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 Aug 26 19:17:16 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:16 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:16 devstack sudo[114474]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1" returned: 0 in 0.272s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:17:16 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d" returned: 0 in 0.453s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad235c04-d741-4c99-8d87-2d04d23a4ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255477b6-dc4b-409d-8a6a-729d290b9bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:17 devstack sudo[114483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d Aug 26 19:17:17 devstack sudo[114483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:17 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Volume volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 (7621ed2f-11aa-4fef-9cf9-efb361dfbff1): created successfully Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255477b6-dc4b-409d-8a6a-729d290b9bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Flow 'volume_create_manager' (59062f98-167a-4be1-b28e-9fec39eca1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-77cee23d-a5f8-4184-a063-d78df7b2f0e0-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-cb0b40f3-ea3f-419f-850e-9464cd287b06 tempest-ProjectReaderTests-1945611304 None] Created volume successfully. Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-77cee23d-a5f8-4184-a063-d78df7b2f0e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-02086690-acf2-4615-9900-3e06712fa432" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-02086690-acf2-4615-9900-3e06712fa432" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-77cee23d-a5f8-4184-a063-d78df7b2f0e0" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-77cee23d-a5f8-4184-a063-d78df7b2f0e0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Deleting offline snapshot 77cee23d-a5f8-4184-a063-d78df7b2f0e0 of volume 02086690-acf2-4615-9900-3e06712fa432 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] snapshot_file for this snap is: volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c0270b-abac-472a-88a5-a257dfff7959]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:17 devstack sudo[114483]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-90666860-3f9a-490c-801b-f72e4d390d0d" returned: 0 in 0.288s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-quobyte-90666860-3f9a-490c-801b-f72e4d390d0d" released by "delete_volume" :: held 0.796s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:17 devstack sudo[114485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 Aug 26 19:17:17 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Created reservations ['efae3bef-026d-4d32-a98a-3b63d25512cb', '7b4353ae-9631-4fb6-ac30-2a21fbd78627', '61d41588-0df1-42c8-b68b-f2aefeb2700e', '56a6bade-35d3-47da-9ee5-79f337582adf'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:17 devstack sudo[114488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:17:17 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:17 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0" returned: 0 in 0.438s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02086690-acf2-4615-9900-3e06712fa432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c521dc-e6a2-4659-8ca4-6522718a00f0]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:17 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.311s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:17:17 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Deleted volume successfully. Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-329ac5f3-46a3-4f5f-9d13-e2cff7f33396 tempest-SnapshotDependencyTests-2000186266 None] Lock "cinder-90666860-3f9a-490c-801b-f72e4d390d0d-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Acquiring lock "cinder-7621ed2f-11aa-4fef-9cf9-efb361dfbff1-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:17 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 Aug 26 19:17:17 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Lock "cinder-7621ed2f-11aa-4fef-9cf9-efb361dfbff1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Acquiring lock "cinder-quobyte-7621ed2f-11aa-4fef-9cf9-efb361dfbff1" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Lock "cinder-quobyte-7621ed2f-11aa-4fef-9cf9-efb361dfbff1" acquired by "delete_volume" :: waited 0.020s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[330958b8-1ae4-42dc-bd83-b6c9f99e8c64]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:17 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:18 devstack sudo[114497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 Aug 26 19:17:18 devstack sudo[114497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:18 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432" returned: 0 in 0.504s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:18 devstack sudo[114503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 Aug 26 19:17:18 devstack sudo[114503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:18 devstack sudo[114497]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1" returned: 0 in 0.408s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:18 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1 Aug 26 19:17:18 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:18 devstack sudo[114503]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:18 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-7621ed2f-11aa-4fef-9cf9-efb361dfbff1" returned: 0 in 0.285s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0" returned: 0 in 0.454s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Lock "cinder-quobyte-7621ed2f-11aa-4fef-9cf9-efb361dfbff1" released by "delete_volume" :: held 0.753s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:18 devstack sudo[114514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0 Aug 26 19:17:18 devstack sudo[114514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Created reservations ['9cd7a77d-f877-4b63-b973-b5c136c163b9', '4dba9b13-189e-4e82-b483-3ff453a65745', 'd8b6cbf7-81f5-49b7-a161-0dd25c9d3314', '066110ef-ac83-4bad-95c5-efadb54f3373'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:18 devstack sudo[114516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:17:18 devstack sudo[114516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:18 devstack sudo[114514]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432.77cee23d-a5f8-4184-a063-d78df7b2f0e0" returned: 0 in 0.299s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:18 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-77cee23d-a5f8-4184-a063-d78df7b2f0e0" released by "_delete_snapshot" :: held 1.831s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-02086690-acf2-4615-9900-3e06712fa432" released by "delete_snapshot" :: held 1.854s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Created reservations ['f156c92b-72b5-4dbb-b7e7-76b60a5d27d5', 'a3046a5d-aae0-4672-af3b-a3e0d69b45b4', '96f313c2-2349-40ff-a1c6-1f6fb7300d4e', 'b18c701e-2fa9-4f11-a982-94c1220f3170'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:19 devstack sudo[114516]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.318s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:17:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Deleted volume successfully. Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c340adc-72e1-4257-8881-800bc688966a tempest-ProjectReaderTests-1945611304 None] Lock "cinder-7621ed2f-11aa-4fef-9cf9-efb361dfbff1-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:19 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Delete snapshot completed successfully. Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-d0c05e99-6f4e-497d-a754-99bb938ee5f7 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-77cee23d-a5f8-4184-a063-d78df7b2f0e0-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-02086690-acf2-4615-9900-3e06712fa432-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-02086690-acf2-4615-9900-3e06712fa432-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-02086690-acf2-4615-9900-3e06712fa432" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-02086690-acf2-4615-9900-3e06712fa432" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba23143-acb2-493c-b3b1-5976e8d91796]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:19 devstack sudo[114520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 Aug 26 19:17:19 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:19 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432" returned: 0 in 0.467s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:19 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:19 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432 Aug 26 19:17:19 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:20 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-02086690-acf2-4615-9900-3e06712fa432" returned: 0 in 0.306s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-02086690-acf2-4615-9900-3e06712fa432" released by "delete_volume" :: held 0.858s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Created reservations ['91d8de24-7255-4083-9fa1-0eed03a923fc', '87d49ac6-9673-4409-9631-0432b035945e', '344ac984-dc6e-4e35-bc28-b7ee22c71d6f', '1314e66f-65d4-4e4d-9a44-2489f2760d6c'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:20 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:17:20 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:20 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.338s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:17:20 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Deleted volume successfully. Aug 26 19:17:20 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-0c03c74e-6330-445a-b6ea-ae3afc5476f1 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-02086690-acf2-4615-9900-3e06712fa432-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (5dd472c0-a179-4f8b-9e88-c853abbbab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab088e09-277c-4960-83a0-93d53443dfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab088e09-277c-4960-83a0-93d53443dfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1524072455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1b7668-43b4-4568-9ece-8dd891e58e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:17:21Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eadbc7e-a035-4706-be1b-e136b2c3f92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eadbc7e-a035-4706-be1b-e136b2c3f92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f645b825-516b-47bf-8726-3acb9e6ae4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f645b825-516b-47bf-8726-3acb9e6ae4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf1b7668-43b4-4568-9ece-8dd891e58e69', 'volume_name': 'volume-bf1b7668-43b4-4568-9ece-8dd891e58e69', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d861592c-b74e-429c-852f-87af203fa573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d861592c-b74e-429c-852f-87af203fa573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a924505e-831f-4a2e-ae26-f98007236d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:21 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Volume bf1b7668-43b4-4568-9ece-8dd891e58e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf1b7668-43b4-4568-9ece-8dd891e58e69', 'volume_size': 1} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T17:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1524072455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1b7668-43b4-4568-9ece-8dd891e58e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71fa46bac34c25bba008603e331518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T17:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T17:17:21Z,use_quota=True,user_id='1e9c16baac944852a9790932b9f11df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d0c4706-059e-446b-a39c-3a699997549d),volume_type_id=5d0c4706-059e-446b-a39c-3a699997549d)}" {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Creating volume bf1b7668-43b4-4568-9ece-8dd891e58e69 {{(pid=93671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Selected osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 as target Quobyte volume. {{(pid=93671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 19:17:21 devstack cinder-volume[93671]: INFO cinder.volume.drivers.remotefs [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] casted to osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935 Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 1073741824 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:21 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 1073741824 Aug 26 19:17:21 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:21 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 1073741824" returned: 0 in 0.506s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:21 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:21 devstack sudo[114538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 Aug 26 19:17:21 devstack sudo[114538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:22 devstack sudo[114538]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69" returned: 0 in 0.332s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:22 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'} {{(pid=93671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 19:17:22 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a924505e-831f-4a2e-ae26-f98007236d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1b7668-43b4-4568-9ece-8dd891e58e69', 'volume_size': 1}' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bd1f61-698e-46a4-9991-0f8a990442d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 19:17:22 devstack cinder-volume[93671]: INFO cinder.volume.flows.manager.create_volume [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Volume volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 (bf1b7668-43b4-4568-9ece-8dd891e58e69): created successfully Aug 26 19:17:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bd1f61-698e-46a4-9991-0f8a990442d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 19:17:22 devstack cinder-volume[93671]: DEBUG cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Flow 'volume_create_manager' (5dd472c0-a179-4f8b-9e88-c853abbbab71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 19:17:22 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-bff15526-eb89-4a51-8fd2-2b1e75fe3a8c tempest-ProjectMemberTests-1720022270 None] Created volume successfully. Aug 26 19:17:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:23 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Creating offline snapshot 12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 of volume bf1b7668-43b4-4568-9ece-8dd891e58e69 {{(pid=93671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 19:17:23 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2760130c-303f-4b0c-a1d1-7525f3c89bfc]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:23 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:23 devstack sudo[114542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 Aug 26 19:17:23 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:24 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69" returned: 0 in 0.452s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 1G {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:24 devstack sudo[114547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 1G Aug 26 19:17:24 devstack sudo[114547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:24 devstack sudo[114547]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 1G" returned: 0 in 0.613s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:24 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:24 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 Aug 26 19:17:24 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:25 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 -F qcow2 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52" returned: 0 in 0.357s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:25 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 is being set with open permissions: ugo+rw Aug 26 19:17:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:25 devstack sudo[114558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 Aug 26 19:17:25 devstack sudo[114558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:25 devstack sudo[114558]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52" returned: 0 in 0.318s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:25 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.info Aug 26 19:17:25 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:25 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.info" returned: 0 in 0.308s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:25 devstack cinder-volume[93671]: WARNING cinder.volume.drivers.remotefs [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.info is being set with open permissions: ugo+rw Aug 26 19:17:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.info {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:25 devstack sudo[114565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.info Aug 26 19:17:25 devstack sudo[114565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:25 devstack sudo[114565]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:25 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.info" returned: 0 in 0.289s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:26 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-b8e3c99f-8caa-46df-9907-cb8cf854bb8b tempest-ProjectMemberTests-1720022270 None] Create snapshot completed successfully Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-12fc4d92-8dc8-4e88-8cd6-be87f51b3a52-delete_snapshot" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-12fc4d92-8dc8-4e88-8cd6-be87f51b3a52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-bf1b7668-43b4-4568-9ece-8dd891e58e69" by "delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-bf1b7668-43b4-4568-9ece-8dd891e58e69" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-12fc4d92-8dc8-4e88-8cd6-be87f51b3a52" by "_delete_snapshot" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-12fc4d92-8dc8-4e88-8cd6-be87f51b3a52" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Deleting offline snapshot 12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 of volume bf1b7668-43b4-4568-9ece-8dd891e58e69 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] snapshot_file for this snap is: volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 {{(pid=93671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7244c368-e1c7-4a07-bff3-8621e7e2db5c]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:26 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:27 devstack sudo[114568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 Aug 26 19:17:27 devstack sudo[114568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:27 devstack sudo[114568]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52" returned: 0 in 0.381s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:27 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.remotefs [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf1b7668-43b4-4568-9ece-8dd891e58e69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 19:17:27 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3626d7f6-cf5c-4cdb-8109-fbe3f344f49f]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:27 devstack sudo[114573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 Aug 26 19:17:27 devstack sudo[114573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:27 devstack sudo[114573]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69" returned: 0 in 0.467s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:27 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:27 devstack sudo[114579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 Aug 26 19:17:27 devstack sudo[114579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:28 devstack sudo[114579]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52" returned: 0 in 0.426s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:28 devstack sudo[114585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52 Aug 26 19:17:28 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:28 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:28 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69.12fc4d92-8dc8-4e88-8cd6-be87f51b3a52" returned: 0 in 0.301s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-12fc4d92-8dc8-4e88-8cd6-be87f51b3a52" released by "_delete_snapshot" :: held 1.695s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-bf1b7668-43b4-4568-9ece-8dd891e58e69" released by "delete_snapshot" :: held 1.734s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:28 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Created reservations ['8c3b20ea-a630-4323-a43f-a3760017a12c', '0be48794-e66c-4bd1-bedd-9bdf4a06309b', '58cba8eb-f891-4ec2-83b1-da87fb2f4907', '061e2561-7983-4eb4-8b87-a4036fc80852'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:28 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Delete snapshot completed successfully. Aug 26 19:17:28 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-13b4e8ff-88d7-4562-8db5-272ecc94dc09 tempest-ProjectMemberTests-1720022270 None] Lock "cinder-12fc4d92-8dc8-4e88-8cd6-be87f51b3a52-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-bf1b7668-43b4-4568-9ece-8dd891e58e69-delete_volume" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Lock "cinder-bf1b7668-43b4-4568-9ece-8dd891e58e69-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Acquiring lock "cinder-quobyte-bf1b7668-43b4-4568-9ece-8dd891e58e69" by "delete_volume" {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-bf1b7668-43b4-4568-9ece-8dd891e58e69" acquired by "delete_volume" :: waited 0.025s {{(pid=93671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e435744e-a1c4-4650-a0e5-37c148a3ee1e]: (4, 'qcow2') {{(pid=94687) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:29 devstack sudo[114590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 Aug 26 19:17:29 devstack sudo[114590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:29 devstack sudo[114590]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69" returned: 0 in 0.389s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:29 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69 Aug 26 19:17:29 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:29 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33/volume-bf1b7668-43b4-4568-9ece-8dd891e58e69" returned: 0 in 0.302s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Lock "cinder-quobyte-bf1b7668-43b4-4568-9ece-8dd891e58e69" released by "delete_volume" :: held 0.764s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:29 devstack cinder-volume[93671]: DEBUG cinder.quota [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Created reservations ['bf3266ab-3b26-4186-bddf-49d983636084', 'd7625c82-563a-452a-b0cd-7d474b233b80', '173a999a-eca3-49c9-b2b7-b0dd723490de', 'e79f5e42-be45-4e90-9194-948eb5be6451'] {{(pid=93671) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 19:17:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 19:17:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 19:17:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935': None} {{(pid=93671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 19:17:30 devstack cinder-volume[93671]: DEBUG cinder.volume.drivers.quobyte [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-559f0275-05b6-41f4-b287-59137b357935'] {{(pid=93671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 19:17:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.lockutils [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 19:17:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 19:17:30 devstack sudo[114599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33 Aug 26 19:17:30 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 19:17:30 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root Aug 26 19:17:30 devstack cinder-volume[93671]: DEBUG oslo_concurrency.processutils [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7d61fb5678d682bbf5523e8661f67d33" returned: 0 in 0.290s {{(pid=93671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 19:17:30 devstack cinder-volume[93671]: DEBUG cinder.manager [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Notifying Schedulers of capabilities ... {{(pid=93671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 19:17:30 devstack cinder-volume[93671]: INFO cinder.volume.manager [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Deleted volume successfully. Aug 26 19:17:30 devstack cinder-volume[93671]: DEBUG cinder.coordination [None req-992c2ab4-19da-4d4c-9319-8e99df6b4c4e tempest-ProjectMemberTests-1720022270 None] Lock "cinder-bf1b7668-43b4-4568-9ece-8dd891e58e69-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=93671) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 19:17:40 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=68,cinder:INSERT=29,cinder:UPDATE=93,cinder:DELETE=6 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 19:17:40 devstack cinder-volume[93671]: DEBUG dbcounter [-] [93671] Writing DB stats cinder:SELECT=67,cinder:INSERT=22,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=93671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}